-- Logs begin at Tue 2022-05-31 19:57:59 UTC, end at Tue 2022-05-31 21:27:15 UTC. -- May 31 20:41:59.652915 dv-cinder-839793-16-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 31 20:41:59.662489 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 20:41:59 2022] *** May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: nodename: dv-cinder-839793-16-iscsi May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: machine: x86_64 May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: clock source: unix May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: pcre jit disabled May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: detected number of CPU cores: 4 May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: current working directory: / May 31 20:41:59.664517 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: detected binary path: /usr/bin/uwsgi-core May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: your processes number limit is 47680 May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: your memory page size is 4096 bytes May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: detected max file descriptor number: 2048 May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: lock engine: pthread robust mutexes May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: thunder lock: enabled May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 31 20:41:59.665181 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 20:41:59.709639 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: Python main interpreter initialized at 0x557aaa9a09c0 May 31 20:41:59.709639 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: python threads support enabled May 31 20:41:59.709639 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: your server socket listen backlog is limited to 100 connections May 31 20:41:59.709639 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: your mercy for graceful operations on workers is 90 seconds May 31 20:41:59.710054 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: mapped 403077 bytes (393 KB) for 2 cores May 31 20:41:59.710128 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: *** Operational MODE: preforking *** May 31 20:41:59.710380 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: *** uWSGI is running in multiple interpreter mode *** May 31 20:41:59.710380 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: spawned uWSGI master process (pid: 80364) May 31 20:41:59.710588 dv-cinder-839793-16-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 31 20:41:59.712068 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: spawned uWSGI worker 1 (pid: 80377, cores: 1) May 31 20:41:59.712068 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: spawned uWSGI worker 2 (pid: 80378, cores: 1) May 31 20:41:59.712068 dv-cinder-839793-16-iscsi devstack@keystone.service[80364]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 20:42:05.512945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:42:05.512945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: from cryptography.utils import int_from_bytes May 31 20:42:05.513738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:42:05.513738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: from cryptography.utils import int_from_bytes May 31 20:42:05.514029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:42:05.514029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes May 31 20:42:05.515001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 20:42:05.515001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes May 31 20:42:05.564240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:42:05.564427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:42:05.564607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] command line args: [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:42:05.564717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 20:42:05.564878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:42:05.564968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 20:42:05.565041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ================================================================================ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:42:05.565140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] command line args: [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 20:42:05.565296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] admin_token = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.565387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 20:42:05.565493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ================================================================================ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 20:42:05.565579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_dir = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.565712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.565798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.565912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_source = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_dir = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] debug = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_source = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] debug = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.566918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.567931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_config_append = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_config_append = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_dir = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_dir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.568976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.569947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.570976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.571977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] publish_errors = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] publish_errors = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.572994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] standard_threads = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] standard_threads = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.573945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_journal = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_json = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.574888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_journal = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_stderr = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_json = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_syslog = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_stderr = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_syslog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.575854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 20:42:05.575971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.576709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.577960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.578919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.579960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.580906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.581979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.582950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.583897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.584997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.585962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.586924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.587955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.588909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.589877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.590981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.591878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.592022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.592206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.592328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.593872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.594895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.595902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.596997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.597971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.598928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.599793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.600859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.external = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.601880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.external = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.password = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.602642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.token = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.password = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.603955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.token = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.604998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.605880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.606957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.607931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.608208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.608334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.608527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.608650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.608776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.609765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.610971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.611916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.612948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.613879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.614924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.615889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.616984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.617827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.618999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.619958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.620913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.621974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.622887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.623906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.624987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.625821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.626984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.627947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.628906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.629833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.630890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.631988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.632951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.633919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.634880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.635932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.636992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.637985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.638930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.639049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.639167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.639805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.639930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.640898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.641996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.642953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.643906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.644997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.645980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.646951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.647905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.648999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.649998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.650964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.651929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.652965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.653085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.654791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.655532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.655782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.656031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.656266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.656506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.656733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.656972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.657203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 20:42:05.657371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 20:42:05.681478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.681705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.681945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.687865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.688261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.688657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.691128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.698141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.720445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.720675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.725014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.725247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.788424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.788634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.846696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.846934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.847060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.847216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.915280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.915494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.915708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.915796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.915928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.916802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.940921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.941764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.953769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.954350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.966509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.966733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.966956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.967933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.968069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.968284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 20:42:05.984918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.985123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:42:05.985458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.985656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:42:05.985766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.985940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.986026 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:42:05.986200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.986452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.986532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.986655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 20:42:05.986734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.986923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.987181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.987442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.987754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.997600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.997876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.998163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.998438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.999529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:05.999807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.000072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.000343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.007446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.008780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.010727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.011002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.011283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.011688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.011950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.012206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.012875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.013785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.014080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.014957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.015225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.015491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.040782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.041934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.042371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.042646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.043654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.043930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.048459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.048743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.049019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.049756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.050067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.050351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.056355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.056640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.057557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.057836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.061827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.062127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.063199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.063997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.064849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.066059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.083298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.083495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.083596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.083777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.088087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.088490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.091701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.091992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.092130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.092457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.096960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.097479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.100533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.101054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.105786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.106979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.107173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.107255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.107506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.107793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.128091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.128304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.128576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.128835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.128942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.129324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.129597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.129872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.136836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.137731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.138574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.138845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.139495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.139765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.141842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.142143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.142420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.142709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.142826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.143004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.143106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.143392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.143683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.143975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.156387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.156666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.156944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.157218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.157447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.157538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.157736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.157818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.158051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.158148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.158334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.158611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.158881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.159155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.177516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.178289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.180911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.181643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.184404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.185048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.186040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.187290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.188265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.188546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.188838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.188946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.189233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.189521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.196544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.197160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.198232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.198844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.201535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.201858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.202169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.202256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.202445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.202527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.202732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.203008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.211872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.212173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.212417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.212581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.212718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.212999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.220991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.221151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 20:42:06.221286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.221366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.221546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.221629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.221817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.221990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.222980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.223905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.224695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 20:42:06.263725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557aaa9a09c0 pid: 80377 (default app) May 31 20:42:06.263856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557aaa9a09c0 pid: 80378 (default app) May 31 20:42:06.267215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768721-4e57-4da1-b1c0-9a01fdf740ff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:06.267509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768721-4e57-4da1-b1c0-9a01fdf740ff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:06.267785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71768721-4e57-4da1-b1c0-9a01fdf740ff None None] PATH_INFO: `/v3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:06.272009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Tue May 31 20:42:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:15.544577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:15.545192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:15.545192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:15.550237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:15.556365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:15.556929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:15.556929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:15.625853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: INFO dbcounter [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] Registered counter for database keystone May 31 20:42:15.647970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG oslo_db.sqlalchemy.engines [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:42:15.654977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writer thread running {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:42:15.941058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80377) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 20:42:15.942468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80377) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 20:42:15.997347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:15.999608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:16.124430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 31 20:42:16.301997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:16.371341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: INFO dbcounter [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] Registered counter for database keystone May 31 20:42:16.391159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG oslo_db.sqlalchemy.engines [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 20:42:16.397548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writer thread running {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 20:42:16.624168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb7082-77b4-4038-b86a-8f4ec2947a33 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:16.628556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:16.629215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:16.629498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:16.629771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:16.638199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:16.689959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 20:42:16.690294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db621a04-3c68-419e-8db8-b4df0cefe066 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:16.700476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 31 20:42:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 20:42:16.707237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:16.722235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed43b98-3cc3-4243-8544-0ad82aa1ee02 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:16.726918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:16.728047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:16.728331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:16.728616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] PATH_INFO: `/v3/projects/f6a1a8d766964543bcc4e46371605ff7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:16.730145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6a1a8d766964543bcc4e46371605ff7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:16.783095 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 20:42:16.783442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601fa1f-1de5-4f6e-9878-eb2c3ddfca77 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:16.788225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Tue May 31 20:42:16 2022] GET /identity/v3/projects/f6a1a8d766964543bcc4e46371605ff7 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:19.050111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767df45-b3bb-46b9-9f32-85ce2c0540a0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:19.050631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767df45-b3bb-46b9-9f32-85ce2c0540a0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:19.050631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767df45-b3bb-46b9-9f32-85ce2c0540a0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:19.054706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:19.060530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:19.061002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:19.061106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:19.080323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:19.081864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:19.089734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 31 20:42:19.112605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767df45-b3bb-46b9-9f32-85ce2c0540a0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:19.125780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767df45-b3bb-46b9-9f32-85ce2c0540a0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:19.130012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:19.130655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:19.130937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:19.131209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:19.139761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:19.141563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368906c-8dae-4abc-8d84-782dbd97c58a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:19.150993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Tue May 31 20:42:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 20:42:19.157597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:19.167103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91aee0-320c-4c2f-8b04-30453d1dbab2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:19.172242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:19.173122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:19.173409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:19.173692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:19.175155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:19.177003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd585068-8c05-48d5-855d-e010085efb90 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:19.178649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Tue May 31 20:42:19 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:21.511878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0807-c3b7-41ea-b141-a37536b8fba3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.512429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0807-c3b7-41ea-b141-a37536b8fba3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.512429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0807-c3b7-41ea-b141-a37536b8fba3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.514450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:21.520121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.520667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.520667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.537961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:21.539151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:21.542263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4d33-7e0e-41c9-a538-00c719c17caa None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.542626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4d33-7e0e-41c9-a538-00c719c17caa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.542981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4d33-7e0e-41c9-a538-00c719c17caa None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.544352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:42:21.550229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.550522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.550804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.592735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG passlib.handlers.bcrypt [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80378) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 20:42:21.593154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG passlib.handlers.bcrypt [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80378) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 20:42:21.620124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:21.640743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:21.642416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:21.644450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:21.669006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:21.751537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:21.755502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df887ee-2b1e-444e-9d79-a8311a4e525c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:21.774505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:21.793645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:21.795761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.795761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.795761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.807882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:21.819666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:21.820579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:21.821446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:21.826709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:21.883682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e42b-81eb-4374-9d95-0bdc55c8cf7c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:21.886214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:21.910199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:21.922143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:21.923083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.923370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.923650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.928596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0bec9-bba8-499e-8c97-f46a786dbfce None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:21.964814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:21.965490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:21.965774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:21.966089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:21.966885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:21.967204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:21.968692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:21.980566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:21.986583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:21.995688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:21.997247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.087961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bdbb-e74e-4bd0-b54f-c7781fe093ba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:22.101284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:42:22.107710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:22.110613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:22.122519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:22.124051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:22.124333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:22.124602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:22.126092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:22.127551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.129169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:21 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:22.134477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:22.149127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:22.208577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefc3b-5e93-49c0-a67b-3adbc89d1871 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:22.235764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d49-1f05-4618-90a1-1f9dc5f7dc9f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:22.243806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:22.244610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:22.244891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:22.245175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:22.264202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:22.265683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.270360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:22.271166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:22.271450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:22.271737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:22.272912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:22.274400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.276184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:22.282150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:42:22.287267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:22.288277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:22.289412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:42:22.289412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:42:22.289412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:22.289412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:22.289412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:22.296216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:22.353984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:22.364508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:22.386614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cec6b1-33aa-4399-9846-b04948901e99 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:22.400678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7714a-c6a3-428c-a72d-10caa4370fab None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:22.422184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:22.422856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:22.423149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:22.423433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:22.424282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.domain.id=default, user.id=8f14392ec7e347fab1ef8b6cbe7e2488) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:22.424601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:22.426093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4c750-8ecc-42e0-aeed-3b1406fffbdb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.433076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 31 20:42:22 2022] GET /identity/v3/role_assignments?user.id=8f14392ec7e347fab1ef8b6cbe7e2488&scope.domain.id=default&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:22.436342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:22.437019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:22.437301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:22.437575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:22.439045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:22.439045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:22.440066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ef7b7-2f59-41d2-859d-4b9fee67d7f2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:22.460901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:25.254200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0b4a-11a3-4f69-b322-ff82f4ba09ef None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.255217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0b4a-11a3-4f69-b322-ff82f4ba09ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.255725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb0b4a-11a3-4f69-b322-ff82f4ba09ef None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.257332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:25.263256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25cb4e-424a-43ed-8ead-aeeb5532cf47 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.263695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25cb4e-424a-43ed-8ead-aeeb5532cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.263815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25cb4e-424a-43ed-8ead-aeeb5532cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.291224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7c25cb4e-424a-43ed-8ead-aeeb5532cf47 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:25.292680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7c25cb4e-424a-43ed-8ead-aeeb5532cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:25.384709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:25.423999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0b4a-11a3-4f69-b322-ff82f4ba09ef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:25.475156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da8734-086e-4df7-b619-694e766c1d5b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.475817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da8734-086e-4df7-b619-694e766c1d5b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.476293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da8734-086e-4df7-b619-694e766c1d5b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.477912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:25.484700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143bb4e-6ff8-4c68-b75b-9b9f87216788 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.485264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143bb4e-6ff8-4c68-b75b-9b9f87216788 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.485735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143bb4e-6ff8-4c68-b75b-9b9f87216788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.529807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f143bb4e-6ff8-4c68-b75b-9b9f87216788 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:25.531627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f143bb4e-6ff8-4c68-b75b-9b9f87216788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:25.610024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:25.616544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb0b4a-11a3-4f69-b322-ff82f4ba09ef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:25.660329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:25.667946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9c8b-a924-4dd1-99ce-c46318c4495f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.668747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9c8b-a924-4dd1-99ce-c46318c4495f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.669772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9c8b-a924-4dd1-99ce-c46318c4495f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.671755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 14/26] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:25.677302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.678290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.678790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.689628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:25.690483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:25.690775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:25.691058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:25.721720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:25.723723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:25.725596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:25.727431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:25.733049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:42:25.761876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:25.762762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:25.764178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:42:25.764178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:42:25.764178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:42:25.764178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:25.769395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 13/27] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:25.771477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:25.868189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 15/28] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:25.875299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:25.956400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b724-ed27-4d7d-952f-2dd8934cf25b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.007899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.009359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.010148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.010614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.011725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:26.014551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:26.022920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609707-7d6d-4136-b97a-f8bf5941067d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.032017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:26.080829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.081524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.081811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.082187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.082869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:26.083185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:26.084599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8187-af9e-4ea1-ba1d-119dc69bc072 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:26.097170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 16/29] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:26.102267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ed81-6ea3-45ff-9b44-9dc7199c93d6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.102267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ed81-6ea3-45ff-9b44-9dc7199c93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.102267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ed81-6ea3-45ff-9b44-9dc7199c93d6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.102267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 17/30] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:26.102267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9ed81-6ea3-45ff-9b44-9dc7199c93d6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:26.238214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9ed81-6ea3-45ff-9b44-9dc7199c93d6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.272624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 14/31] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 31 20:42:25 2022] POST /identity/v3/roles => generated 219 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:26.274605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:26.282768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.283625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.283913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.284196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.308516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c8399d86-37bc-420b-858a-4e1c8b475d6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:26.327695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:26.329385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:26.331543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 18/32] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:26.332858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21dbf-e66c-48a4-aa0d-b1676bad02a2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.332858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21dbf-e66c-48a4-aa0d-b1676bad02a2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.333076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21dbf-e66c-48a4-aa0d-b1676bad02a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.364971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e8b21dbf-e66c-48a4-aa0d-b1676bad02a2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:26.367378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8b21dbf-e66c-48a4-aa0d-b1676bad02a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:26.390519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:26.411072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:26.480739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8098db-409c-419a-85f5-ee465801ac62 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.514369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 19/33] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:26.517205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fdb3a-0bc0-4b6c-95a0-73abe9d147a3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.517692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fdb3a-0bc0-4b6c-95a0-73abe9d147a3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.518271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fdb3a-0bc0-4b6c-95a0-73abe9d147a3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.520943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 20/34] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:26.526382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fdb3a-0bc0-4b6c-95a0-73abe9d147a3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:26.555318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.555318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.555318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.555318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.556368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:26.560801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cec6f-652b-427d-82a6-29dcc04fba7e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:26.689090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fdb3a-0bc0-4b6c-95a0-73abe9d147a3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.694851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 15/35] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:42:26 2022] POST /identity/v3/projects => generated 301 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:26.697944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.697944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.697944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.723686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:26.725923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:26.743732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.744615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.744931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.745238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.746166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:26.746459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:26.748032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:26.764298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 21/36] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:26.765199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:26.797858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:26.848098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 16/37] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:26.849661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:26.901953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d184e-8a44-4656-a1d6-3e01a509b613 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:26.926556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:26.943233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:26.943852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:26.944194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:26.944433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:26.945197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:26.946665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118de2c-3499-47b7-a9bb-9dae78daa478 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.018191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2e248-582e-4dad-b277-9c4ac3a04667 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:27.066640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:27.068194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.068732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.069879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.072081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:27.074849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.078383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 17/38] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:26 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:27.079646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:27.140791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 22/39] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 31 20:42:26 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:27.142439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6088-10dd-40a6-9a82-82340e932234 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.142936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6088-10dd-40a6-9a82-82340e932234 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.143084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6088-10dd-40a6-9a82-82340e932234 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.145516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 23/40] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:27.145516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d6088-10dd-40a6-9a82-82340e932234 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:27.271996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:27.273123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d8149-f078-4954-8573-31f274e2d45a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:27.284874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:27.298966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d6088-10dd-40a6-9a82-82340e932234 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:27.330006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:27.331771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.332606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.333452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.335379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:27.337862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.358157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:27.360296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.360296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.360616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.364205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:27.368201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ec59-ef71-464b-b074-089ab4f15e9b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.374294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 24/41] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:27.375627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.376155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.376671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.407528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:27.410387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:27.436392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 18/42] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 31 20:42:27 2022] POST /identity/v3/roles => generated 223 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:27.437725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:27.534751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 25/43] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:27.562799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:27.634546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323648ac-5916-4f98-8565-a86285ece7a5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:27.684974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:27.687324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:27.688757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.689238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.689690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] PATH_INFO: `/v3/domains/default/users/8f14392ec7e347fab1ef8b6cbe7e2488/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.693020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8f14392ec7e347fab1ef8b6cbe7e2488, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:27.695303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.725417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2e2f8-2f2d-4982-9295-92c6eb62c3d4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:27.777470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 19/44] 10.222.0.55 () {58 vars in 1361 bytes} [Tue May 31 20:42:27 2022] PUT /identity/v3/domains/default/users/8f14392ec7e347fab1ef8b6cbe7e2488/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:27.792906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:27.794861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:27.795287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:27.795928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:27.797880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:27.800409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228cfe8-5d43-4b56-b2f7-a808cd6cc23a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:27.803299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 26/45] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:27.810203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:27.859368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:27.968195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88629d-0b86-4130-b8bc-ce0cfea1ac3c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:28.009190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:28.009878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:28.010198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:28.010479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:28.011231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:28.013461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf8324-141f-4238-bb32-5ec2ee43740e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:28.120172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 20/46] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:42:27 2022] POST /identity/v3/projects => generated 312 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:30.156719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769cd99-1c1a-412a-aa3f-2554421fc463 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.157247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769cd99-1c1a-412a-aa3f-2554421fc463 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.157595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769cd99-1c1a-412a-aa3f-2554421fc463 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.160219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 27/47] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:42:30.169313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-4415-430b-bf09-e46d072530b2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.169834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-4415-430b-bf09-e46d072530b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.170372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e9d1-4415-430b-bf09-e46d072530b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.196439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0c26e9d1-4415-430b-bf09-e46d072530b2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:30.198450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c26e9d1-4415-430b-bf09-e46d072530b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:30.310310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 21/48] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:30.334713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769cd99-1c1a-412a-aa3f-2554421fc463 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.471504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769cd99-1c1a-412a-aa3f-2554421fc463 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:30.483671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cd23-e670-46ef-ad55-6586a3037f9c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.484310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cd23-e670-46ef-ad55-6586a3037f9c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.484860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cd23-e670-46ef-ad55-6586a3037f9c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.487580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 22/49] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:42:30.495366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.495846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.496320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.509455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:30.510329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.510615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.510892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.519517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:30.520792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:30.522675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:30.524564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:30.530487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:30.531998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:30.534075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 28/50] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:30.540213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.543616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:30.609382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 23/51] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:30.633761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.655981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73295fae-e628-431f-b9f1-ef077e786dfa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:30.691483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:30.692170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.692457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.692737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.693524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:30.693835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:30.695256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:30.704221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 29/52] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:30.709842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.737466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980b26-316b-4468-bafa-7dafa9f05d78 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:30.773505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:30.774337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.774634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.775015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.776251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:30.777729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:30.781621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:30.781808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 24/53] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:30.787574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.797411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:30.818430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01f0a-fb60-4a03-a0cf-0a9db425b480 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:30.857573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:30.858506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.858816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.859080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.860577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:30.862089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:30.863807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 30/54] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:30 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:30.869471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:30.890222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d0c54-3f43-489d-aac3-aa2a41d9f92a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:30.926079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:30.926753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:30.927093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:30.927372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:30.928100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:30.929551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc72b-4e8e-426a-abcb-c5a674f60a81 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:30.976089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6140f-3db8-4f91-94d3-dbe9b1858616 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:31.010813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:31.011588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:31.011966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:31.012296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:31.013551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:31.015038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:31.016674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 31/55] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:31.022305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:31.025167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:31.074225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 25/56] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 31 20:42:30 2022] POST /identity/v3/projects => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:42:31.130788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713b4e-f52c-4d04-8d9f-402a8513a0fb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:31.171990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:31.172737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:31.173023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:31.173301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:31.174201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.domain.id=default, user.id=8f14392ec7e347fab1ef8b6cbe7e2488) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:31.174523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:31.176010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeb3e9-b784-481d-ba8d-d81ad8118fb4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:31.186257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 32/57] 10.222.0.55 () {56 vars in 1322 bytes} [Tue May 31 20:42:31 2022] GET /identity/v3/role_assignments?user.id=8f14392ec7e347fab1ef8b6cbe7e2488&scope.domain.id=default&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:33.364358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa984d-8674-4444-b13e-bbbe5c037d73 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:33.364874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa984d-8674-4444-b13e-bbbe5c037d73 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:33.364958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa984d-8674-4444-b13e-bbbe5c037d73 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:33.366327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 26/58] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:33.372064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:33.372524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:33.372628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:33.390359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:33.391568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:33.450665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:33.457887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 33/59] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:33.482348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa984d-8674-4444-b13e-bbbe5c037d73 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:33.540927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:33.583794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa984d-8674-4444-b13e-bbbe5c037d73 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:33.615953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:33.616673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:33.616957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:33.617237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:33.618432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:33.619875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d7e56-06f4-4d3e-9774-8ccce4d151aa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:33.621597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 27/60] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:33.628436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:33.727828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ec8e-aace-47f3-b0c5-83d77844a984 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:33.769347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:33.770067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:33.770359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:33.770645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:33.771374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:33.772843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cfb2-c193-45f4-82c2-26ff4b06ddeb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:33.919284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 34/61] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:42:33 2022] POST /identity/v3/users => generated 275 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:37.481022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f0bde-cf47-44ba-8b1c-1b59d881303b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.481584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f0bde-cf47-44ba-8b1c-1b59d881303b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.481584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f0bde-cf47-44ba-8b1c-1b59d881303b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.483221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 28/62] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:37.488512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.489363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.489873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.515032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:37.516334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:37.534079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21c94-b14d-40f5-a722-40d32b10ba7d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.534390 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21c94-b14d-40f5-a722-40d32b10ba7d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.534674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21c94-b14d-40f5-a722-40d32b10ba7d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.536042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 29/63] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:37.541287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f686-06c8-4854-8bdd-75c0ac4ae2a9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.541583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f686-06c8-4854-8bdd-75c0ac4ae2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.541864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f686-06c8-4854-8bdd-75c0ac4ae2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.571134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9de6f686-06c8-4854-8bdd-75c0ac4ae2a9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:37.572355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9de6f686-06c8-4854-8bdd-75c0ac4ae2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:37.606878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:37.645402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 35/64] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:37.672626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:37.707735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 30/65] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:37.760640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6033-8df3-4621-8e66-0d0816e4001e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.761084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6033-8df3-4621-8e66-0d0816e4001e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.761581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6033-8df3-4621-8e66-0d0816e4001e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.764493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 31/66] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:37.769647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa6033-8df3-4621-8e66-0d0816e4001e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:37.820507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e630-f99b-4887-ac3a-5aab8084d0a2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:37.835608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:37.861166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:37.862008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.862297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.862575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.874716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7e36d7ac-e56c-4d19-8382-3796e4955edb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:37.882534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:37.883552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:37.884379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 36/67] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:37.887240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.887531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.887811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.898314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa6033-8df3-4621-8e66-0d0816e4001e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:37.905570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:37.906792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:37.937636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:37.938485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.938783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.939064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.944776 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:37.950374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-bdac8992-8183-4e4f-947f-0fc41e02cd71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:37.959135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:37.961972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 32/68] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:42:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:37.962720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40078-545d-44ed-9719-94cffad15cb7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:37.963383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40078-545d-44ed-9719-94cffad15cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:37.963383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40078-545d-44ed-9719-94cffad15cb7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:37.963501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 33/69] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:37.964209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40078-545d-44ed-9719-94cffad15cb7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:37.988116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 37/70] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:37.989370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.076539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40078-545d-44ed-9719-94cffad15cb7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.094161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.107090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e148d-d8bb-4777-925f-8e88139b2112 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.112136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.112813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.113099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.113378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.114174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:38.114488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.115963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5f515-4aba-470d-ac02-d44e461248f5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.125593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 34/71] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:38.128859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181985-fe81-4160-82b7-a9e052a63002 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.128859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181985-fe81-4160-82b7-a9e052a63002 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.128859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181985-fe81-4160-82b7-a9e052a63002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.143766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.144052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cb181985-fe81-4160-82b7-a9e052a63002 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:38.144447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.144734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.145012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.145340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cb181985-fe81-4160-82b7-a9e052a63002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:38.145780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:38.146121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.147507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.157367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 38/72] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:38.158215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.192061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.218759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 35/73] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:38.220331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc46-e788-451e-bfa3-35dfbf184b19 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.220656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc46-e788-451e-bfa3-35dfbf184b19 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.220943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc46-e788-451e-bfa3-35dfbf184b19 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.222289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 36/74] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:38.227287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddc46-e788-451e-bfa3-35dfbf184b19 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.263767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71eb5f-5ca8-47d1-ab68-a4a27f4ec555 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.299132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.299936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.300223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.300503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.311277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:38.319208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:38.320138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:38.320874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 39/75] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:38.321584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.336678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddc46-e788-451e-bfa3-35dfbf184b19 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.346946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.379675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.380551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.380834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.381111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.395367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.396832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6dc32-9433-40ca-9b85-a0054fadc781 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.398561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 37/76] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:38.399856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.400143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.400426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.418284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:38.419469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:38.420699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.427369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cb0ae-64df-4978-b1ce-d2e64ec72a4f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.462410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.463291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.463579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.463911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.465125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.467210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.468882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 40/77] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:38.469666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.492000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 38/78] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:38.505851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.578894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe3fb-d8e8-43a1-818f-4c110ad088cd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.614494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.616835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.617650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.617964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.618257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.620275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff378-ae76-4aac-ba8c-2be3f93cee03 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.629149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:38.636870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:38.638427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 41/79] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:38.639631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.661832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.662544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.662832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.663116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.663880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:38.664195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.665418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.665593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.674388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 39/80] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:38.675225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.747626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e6c41-5983-4d2a-8169-4d9aaee6d511 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.777069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea168a-e2d8-4a10-baf3-546154d4be84 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:38.783029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.783700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.783982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.784263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.818433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:38.819094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:38.819382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:38.819663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:38.847398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.856830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.858358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.882289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:38.890260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:38.895075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:38.963362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 42/81] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:38.964230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:38.994744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 40/82] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:38.995822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.055054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.067750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441762-4c32-4043-8048-f1a0563e548b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.090157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.096667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e4eb-a53b-4730-aa9c-88403e5676c6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.101483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.102393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 43/83] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.112453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.133403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.134046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.134348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.134704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.135466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:39.135779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.137194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.149873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 41/84] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.149873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.209711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63b31d-9e83-4115-8fbf-7d529b4fe6cc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.244250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.245129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.245415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.245714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.247934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.249657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.250500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19301fc5-628c-4366-b23a-edfaa45ca690 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.251340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 44/85] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.252120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.271261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.285071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.285978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.286273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.286559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.287838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.289292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.291029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 42/86] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.291911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.316058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.361069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde358-6319-4504-a680-a79a4e955ad4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.395667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750f8a1-c346-4edd-b9bd-e641ee82d157 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.397093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.398030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.398325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.398605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.399820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.401308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.403638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 45/87] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.404421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.436110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.436798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.437084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.437363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.438125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.439586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.506976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215fe68-dbf2-49fe-868b-bf591629ce7c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.532542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.536634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 43/88] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:42:39 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:39.537515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.548346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.549265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.550042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.550345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.552126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.553850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.560280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 46/89] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.560280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.597995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.668071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6129765-f5cd-42df-9ef8-8692685f2eb1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.681742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e940-412e-47fb-b7bd-a25ebce1bb9a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.709333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.710344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.710808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.711374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.720422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.721101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.721386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.721664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.722560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:39.722877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.724386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.730793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 47/90] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=ba84795116f349709142360a12649701 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:39.739074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.814341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.815929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:39.860589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.884207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:39.932711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13058e8-c384-4562-b6f9-e5f6ba235c0b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:39.976597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 44/91] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:39.977558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:39.988935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:39.990178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:39.990690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:39.991433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:39.992681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:39.993112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:39.994654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.003293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 48/92] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:40.004088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:40.124598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86d173-2a56-4f13-9b4b-d558de550dc4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:40.131099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426de379-5876-45ac-9a94-e02c6f7f39e0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:40.152288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:40.168914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:40.170707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:40.171216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:40.171634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] PATH_INFO: `/v3/projects/5462f893203347c7a19505c6c6d00a4b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:40.172922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] RBAC: Authorizing `identity:get_project(project_id=5462f893203347c7a19505c6c6d00a4b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:40.174569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.175657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:40.176504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 49/93] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:40 2022] GET /identity/v3/projects/5462f893203347c7a19505c6c6d00a4b => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:40.176619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:40.176696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:40.177075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:40.183660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:40.198193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:40.314480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:40.316040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.418953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf151f73-2ecc-4933-984e-fca24bba24ad None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:40.466557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 45/94] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:40.472814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:40.473001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:40.473593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:40.473886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:40.474237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:40.475144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=5462f893203347c7a19505c6c6d00a4b, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:40.475464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:40.477061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.483743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 50/95] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:40 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=5462f893203347c7a19505c6c6d00a4b&role.id=ba84795116f349709142360a12649701 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:40.528582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:40.587355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8db55-9d46-4678-b85b-3f7f4621882d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:40.627068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:40.628369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:40.628861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:40.629348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:40.631037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:40.633133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d84c0d-314b-4f9c-a9cc-c1981e4684f9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.635736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 46/96] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:40 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:40.642521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:40.705389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:40.760729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6070-ad21-4baf-bc3a-7ebe1ef03e1f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:40.813707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:40.814401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:40.814687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:40.814967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:40.815814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=8f14392ec7e347fab1ef8b6cbe7e2488) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:40.816125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:40.817638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129951a2-27fb-4ade-b7a5-eff566c28f7e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:40.826169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 51/97] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:40 2022] GET /identity/v3/role_assignments?user.id=8f14392ec7e347fab1ef8b6cbe7e2488&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:42.862425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c357-ccf0-4148-a865-a4fd905bc397 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:42.863409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c357-ccf0-4148-a865-a4fd905bc397 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:42.863894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1c357-ccf0-4148-a865-a4fd905bc397 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:42.865694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 47/98] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:42.871438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bc37-8390-4788-8f75-c9413a52c59e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:42.872283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bc37-8390-4788-8f75-c9413a52c59e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:42.872767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bc37-8390-4788-8f75-c9413a52c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:42.891324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e573bc37-8390-4788-8f75-c9413a52c59e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:42.892851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e573bc37-8390-4788-8f75-c9413a52c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:42.961751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 52/99] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:42.985926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1c357-ccf0-4148-a865-a4fd905bc397 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.039520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89553-9ee4-4b6c-948e-02afb9ca21de None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.040169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89553-9ee4-4b6c-948e-02afb9ca21de None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.040652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89553-9ee4-4b6c-948e-02afb9ca21de None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.042906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 53/100] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:43.051923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920a85e-8a4d-4a5f-bce5-1d406fbc9df8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.052608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920a85e-8a4d-4a5f-bce5-1d406fbc9df8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.053101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920a85e-8a4d-4a5f-bce5-1d406fbc9df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.075076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a920a85e-8a4d-4a5f-bce5-1d406fbc9df8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:43.076595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a920a85e-8a4d-4a5f-bce5-1d406fbc9df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:43.135784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1c357-ccf0-4148-a865-a4fd905bc397 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.151232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:43.166278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:43.174636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.175747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.176259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.176766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.188725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0a1b04dc-6ada-4d3f-b771-1a5c9e264258 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:43.197596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:43.198730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:43.200083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:43.202673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 48/101] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:43.204351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aff50-fb0c-4aaa-b533-a1284ccb66d3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.214511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aff50-fb0c-4aaa-b533-a1284ccb66d3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.214511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aff50-fb0c-4aaa-b533-a1284ccb66d3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.214511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 49/102] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:43.214511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aff50-fb0c-4aaa-b533-a1284ccb66d3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.234279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 54/103] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:43.235903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.236376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.236826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.280695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:43.283701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:43.390242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aff50-fb0c-4aaa-b533-a1284ccb66d3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.426417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.427409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.427903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.428360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.429294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:43.429793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:43.431490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:43.440580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 50/104] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:43.441654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.475575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 55/105] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:43.476573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.483141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:43.550343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3f3ef-29d5-40f5-810f-9b53f9a4e238 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.586092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.587343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.587824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.588305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.589703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:43.591437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:43.593289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 51/106] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:43.594268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.679808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992b98d-c5c1-4048-8318-b200fbbec95b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.694272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:43.720828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28e1e-c723-4a38-a9ef-f7eeee0a5bfc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.723079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:43.728792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.729711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.730479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.731511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] PATH_INFO: `/v3/users/4832baa6135b4e2e9fb2053ca40d0523` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.754759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] RBAC: Authorizing `identity:get_user(user_id=4832baa6135b4e2e9fb2053ca40d0523)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:43.757024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:43.763205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 56/107] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:43 2022] GET /identity/v3/users/4832baa6135b4e2e9fb2053ca40d0523 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:43.763205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.764480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.765291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.765580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.765863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.781537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8dcf8150-c43f-403b-bd17-a0858d7a2708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:43.798334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:43.799170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:43.799924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 52/108] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:43.802024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cfbf7-c2af-49bd-b182-1bb1fe8f1a73 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.802710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cfbf7-c2af-49bd-b182-1bb1fe8f1a73 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.803230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cfbf7-c2af-49bd-b182-1bb1fe8f1a73 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.805858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 53/109] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:43.807317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cfbf7-c2af-49bd-b182-1bb1fe8f1a73 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:43.926256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182e27-f9fd-4a41-9a4c-c18a249e14ce None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.965941 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cfbf7-c2af-49bd-b182-1bb1fe8f1a73 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:43.969622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:43.969622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:43.969622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:43.969622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:43.969919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:43.970624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.004006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.004674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.004963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.005247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.035071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.072422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.073922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546f0fe-fc3a-4299-8777-c3a1cbc3db91 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.110712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 57/110] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:42:43 2022] POST /identity/v3/projects => generated 302 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:44.112286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.140304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.217347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 54/111] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:44.223854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.224227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.224491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.243782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d38b-c62a-436e-a6b0-18f738459a07 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.249198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:44.250553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:44.294067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.294673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.294963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.295245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.296807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:44.296807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.297937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc1f8-fa61-4ae6-b7fe-d356080efe18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.308336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 58/112] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:44.310350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f73e0-2bda-4d00-a5ae-4770bea3d105 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.310649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f73e0-2bda-4d00-a5ae-4770bea3d105 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.310934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f73e0-2bda-4d00-a5ae-4770bea3d105 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.312672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 59/113] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:44.317408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f73e0-2bda-4d00-a5ae-4770bea3d105 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.325490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.344629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 55/114] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:44.345777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.438333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.467291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f73e0-2bda-4d00-a5ae-4770bea3d105 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.482257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5f8b6-f671-4298-a025-ab7fb98b4196 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.504131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.505008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.505295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.505581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.506840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.508312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19940c6f-5439-4099-85cd-d97a21cd28d5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.510071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 60/115] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:44.510071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a119-29f9-453d-ba61-5773efa086c2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.510071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a119-29f9-453d-ba61-5773efa086c2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.510071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287a119-29f9-453d-ba61-5773efa086c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.533180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3287a119-29f9-453d-ba61-5773efa086c2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:44.533503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.534380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.534478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3287a119-29f9-453d-ba61-5773efa086c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:44.534685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.534943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.536178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.538694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.545407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 56/116] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:44.545407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.609327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.610290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 61/117] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:44.611951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60413e80-ff33-414c-9459-09dd8de03d96 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.612406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60413e80-ff33-414c-9459-09dd8de03d96 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.612707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60413e80-ff33-414c-9459-09dd8de03d96 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.617937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 62/118] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:44.624241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60413e80-ff33-414c-9459-09dd8de03d96 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.661220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229c1b7-0ba7-4f8a-8d07-79a5961b58d1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.699350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.700157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.700448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.700727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.711151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:44.713840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:44.719461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:44.736915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 57/119] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:44.737888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.738631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60413e80-ff33-414c-9459-09dd8de03d96 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.777096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.778435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.778727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.779010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.779859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=4832baa6135b4e2e9fb2053ca40d0523) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:44.780397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.781622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b876-ed9b-40d6-9996-d324e2c52eef None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.787769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 63/120] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/role_assignments?user.id=4832baa6135b4e2e9fb2053ca40d0523&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:44.789113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.789412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.789703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.811402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:44.813207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:44.876741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c88d-4eca-491f-bea9-784134e55b7e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:44.906422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:44.916107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 64/121] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:44.921266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:44.928803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e6546-f104-4324-88d1-ace65219278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:44.930326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e6546-f104-4324-88d1-ace65219278d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:44.935642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e6546-f104-4324-88d1-ace65219278d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:44.936253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e6546-f104-4324-88d1-ace65219278d None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:44.937969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e6546-f104-4324-88d1-ace65219278d None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:44.939814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e6546-f104-4324-88d1-ace65219278d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:44.944799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 58/122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:44.947589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e6546-f104-4324-88d1-ace65219278d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.029639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:45.059024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e6546-f104-4324-88d1-ace65219278d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.062775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078187c8-b382-46e8-b902-bfbe20b98628 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.095326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.096377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.096679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.096962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.098031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:45.098333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.099737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.102430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.103508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.104009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.104493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.109064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 59/123] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:45.109686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.117392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:45.126682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:45.127526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:45.128324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:45.130761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 65/124] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:45.132100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.190285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:45.240731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff205ee-6e53-4a12-921e-35937e72d067 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.246782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb7e5-7c53-4ef1-80b1-082f5e41ad35 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.280841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:45.284585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.285436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.292958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.292958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.293194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.293194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.293194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.293194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/574f3416e5e549e58ce2fb7218b67c18/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.293482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, user_id=574f3416e5e549e58ce2fb7218b67c18, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.293482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.297255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:45.305721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:45.306907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:45.307691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 60/125] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:45.308327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.392276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 66/126] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:45 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/574f3416e5e549e58ce2fb7218b67c18/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:45.393553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.453855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36497fa2-78e0-49cd-9fab-6f00bda8365c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.478272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:45.529739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.531291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.534284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.534854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.536839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.539953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.546464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 61/127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:45.547684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.610076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b644-ae04-4bde-bf09-1fd7da0a33bf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.665982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.667041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.667405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.667781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.668652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:45.669042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.670561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.682916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 67/128] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:45.684566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.728548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0dd24-6463-43fd-ba71-9f02377bfad8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.778252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:45.819602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.820299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.820592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.820878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.821934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:45.822113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.823387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.835309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d8be-658f-4873-b69c-ec197fc424eb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:45.841760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 62/129] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:45.842673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.872590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:45.874131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:45.874590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:45.875057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] PATH_INFO: `/v3/projects/5462f893203347c7a19505c6c6d00a4b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:45.876445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] RBAC: Authorizing `identity:get_project(project_id=5462f893203347c7a19505c6c6d00a4b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:45.878170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:45.880397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 68/130] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/projects/5462f893203347c7a19505c6c6d00a4b => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:45.881359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:45.919702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.032452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda78f4-c56d-4b6f-977b-3a884a76aa5c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.083178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24a60d-02ed-41bf-9e40-7861deb375c5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.098038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.098951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.099242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.099583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.101700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.103364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.105323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 63/131] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:46.110284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:46.114281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.126710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.130353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.130353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.130353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.130353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.131647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.133529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 69/132] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:45 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:46.134551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:46.310332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8654c-5e25-448c-9c73-c383f794187a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.312019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496986-9d9e-45d1-81ee-1e0f75ff6a19 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.326649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.374791 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.375617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.375906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.376190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] PATH_INFO: `/v3/projects/5462f893203347c7a19505c6c6d00a4b/users/574f3416e5e549e58ce2fb7218b67c18/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.378997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462f893203347c7a19505c6c6d00a4b, user_id=574f3416e5e549e58ce2fb7218b67c18, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.380462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.383943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.384838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.385167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.385455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.388126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.389536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.391899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 70/133] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:46 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:46.392887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:46.457631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.502723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 64/134] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:46 2022] PUT /identity/v3/projects/5462f893203347c7a19505c6c6d00a4b/users/574f3416e5e549e58ce2fb7218b67c18/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:46.503793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:46.519933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7245ba-af87-495b-bec0-180aaf0dbdec None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.591102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.592009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.592306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.592590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.594599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.597082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.599189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 71/135] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:46 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:46.607341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:46.680550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19268a8d-3458-4b90-a3f6-333827ecc843 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.725315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.726847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.727518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.728043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/574f3416e5e549e58ce2fb7218b67c18/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.731880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, user_id=574f3416e5e549e58ce2fb7218b67c18, role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.734047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6a8b3-08ed-43e8-827f-f03f3e9373c7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.755241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee27b49-862f-4419-8ff0-3e07b7633c52 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:46.786586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.797136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:46.799362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.799362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.799362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/8f14392ec7e347fab1ef8b6cbe7e2488/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.801090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, user_id=8f14392ec7e347fab1ef8b6cbe7e2488, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:46.802698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:46.827209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 65/136] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:46 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/574f3416e5e549e58ce2fb7218b67c18/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:46.828484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c87d-e0ae-454f-b18d-13f8390f4e01 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.832078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c87d-e0ae-454f-b18d-13f8390f4e01 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.832078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c87d-e0ae-454f-b18d-13f8390f4e01 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.832078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 66/137] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:46.836256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:46.836553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:46.836844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:46.857561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:46.858875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:46.890195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:46.904900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 72/138] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:46 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/8f14392ec7e347fab1ef8b6cbe7e2488/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:46.957296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 67/139] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:46.984370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:47.114175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce5b7-c247-4ef0-9d42-e336fac54065 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:47.153525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:47.154451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:47.154791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:47.155154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:47.156493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:47.158205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01def3-98b1-471c-bebb-49ec69f43fcc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:47.160115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 73/140] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:47.165987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:47.287779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e517f-ee74-4ab6-b503-0faa18ef0776 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:47.323741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:47.325343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:47.325822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:47.326314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:47.327250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:47.328899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851536c0-969d-4d18-9baf-a3003ddbb3a2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:47.435887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 68/141] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:42:47 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:47.734117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deeabc-4b44-4d29-9e9e-b566980de5a4 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:47.734474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deeabc-4b44-4d29-9e9e-b566980de5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:47.734712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deeabc-4b44-4d29-9e9e-b566980de5a4 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:47.736120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 74/142] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:47.741942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:47.742547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:47.743056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:47.765649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:47.767259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:47.783090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:47.864830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 69/143] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:47.894280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deeabc-4b44-4d29-9e9e-b566980de5a4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:47.974591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:48.029005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deeabc-4b44-4d29-9e9e-b566980de5a4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.067168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:48.067983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.068268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.068544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.080660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:48.088856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:48.089747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:48.094956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:48.097160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 75/144] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:48.103050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:48.244661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bd70a-ae92-4344-8e12-53193ae2fb1a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.292047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:48.292655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.292975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.293252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.295652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:48.295981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:48.297395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aa6da-2dff-4f34-8e6d-afe3c419a81d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:48.306691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 70/145] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:48.312401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:48.358824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55275-d422-4a36-bbc3-7a17c7c6cab3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.359145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55275-d422-4a36-bbc3-7a17c7c6cab3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.359397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55275-d422-4a36-bbc3-7a17c7c6cab3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.360900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 71/146] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:48.367685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.367685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.367987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.384113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:48.392517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:48.393432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:48.493637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 72/147] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:48.515993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d96e-e086-4d2d-977a-c137aa95ec1c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.526229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:48.551835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:48.603214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:48.604113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.604400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.604678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] PATH_INFO: `/v3/users/4832baa6135b4e2e9fb2053ca40d0523` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.606618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] RBAC: Authorizing `identity:get_user(user_id=4832baa6135b4e2e9fb2053ca40d0523)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:48.608084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:48.609761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 76/148] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:48 2022] GET /identity/v3/users/4832baa6135b4e2e9fb2053ca40d0523 => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:48.647446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:48.668596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819d6c-25a5-4ae4-8bc9-e892a8945ff5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.751094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:48.751935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.753124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.753124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.756926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:48.774164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:48.790075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:48.791004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:48.791769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 73/149] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:48.802682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:48.894437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f885115-d360-4fff-8b87-c480005200dd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.971479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:48.972430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:48.972822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:48.973104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:48.976616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7f79-39fe-4a45-8bcb-7acc72c2501e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:48.977573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:48.979168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:48.981752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 77/150] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:48 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:48.987433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:49.043238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:49.043985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:49.044323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:49.044612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:49.045393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:49.045707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:49.047170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:49.057028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 74/151] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:49.064372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:49.078749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:49.133951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:49.157509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca568f-fe56-4e09-a997-f03faf52c943 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:49.182985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf63c-9d41-408f-86d7-c1a9e9a8b94c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:49.234672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:49.235963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:49.236453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:49.236939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/4832baa6135b4e2e9fb2053ca40d0523/roles/464de7ac8e1e447ab1e5c98a963b867e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:49.242705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, user_id=4832baa6135b4e2e9fb2053ca40d0523, role_id=464de7ac8e1e447ab1e5c98a963b867e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:49.243700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:49.244640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:49.244761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:49.245348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:49.245348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:49.250793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:49.252354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:49.254727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 75/152] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:49 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:49.260437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:49.346242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 78/153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:48 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/users/4832baa6135b4e2e9fb2053ca40d0523/roles/464de7ac8e1e447ab1e5c98a963b867e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:49.390036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50034b-f11b-4ad0-905c-1931d4a67c36 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:49.422344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:49.434350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:49.435035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:49.435404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:49.435693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:49.536378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:49.537980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:49.687173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 76/154] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:49.693107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:49.994272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094f68-ed3e-404f-a222-81fb4a3ca195 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:50.010169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:50.057168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:50.058099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.059035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.059314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.060801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:50.062498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d000458-9097-4d21-9805-cbdadf1183e0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:50.064453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 79/155] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:49 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:50.075648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:50.138610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:50.245340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431135e0-21f0-4711-accf-864aafd75f5a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:50.297548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:50.298249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.298539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.298824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.299682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:50.300000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:50.301464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19ef99-74e6-466e-ad58-16e8ce669192 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:50.309067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 77/156] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:50 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=ba84795116f349709142360a12649701 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:50.320119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fcd8-6663-4053-a50e-01feb0602b6b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.320600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fcd8-6663-4053-a50e-01feb0602b6b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.320980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fcd8-6663-4053-a50e-01feb0602b6b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.322572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 80/157] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:50.329078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf6f2-130c-479a-b258-a29e18e29e5e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.329371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf6f2-130c-479a-b258-a29e18e29e5e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.329655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf6f2-130c-479a-b258-a29e18e29e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.359311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ffaaf6f2-130c-479a-b258-a29e18e29e5e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:50.360641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ffaaf6f2-130c-479a-b258-a29e18e29e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:50.454969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 78/158] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:50.496122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948fcd8-6663-4053-a50e-01feb0602b6b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:50.656964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948fcd8-6663-4053-a50e-01feb0602b6b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:50.697697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:50.698565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.698896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.699684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.707579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8f2d-6318-4f0d-a046-dab65c710e38 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.707881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8f2d-6318-4f0d-a046-dab65c710e38 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.708152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8f2d-6318-4f0d-a046-dab65c710e38 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.709542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 79/159] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:50.712693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:50.715598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:50.716099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:50.716601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:50.720797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:50.721827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:50.722649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 81/160] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:50.734034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:50.758740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:50.758740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:50.787564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:50.849401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:50.901340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 80/161] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:50.941229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:50.968856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393bc7d-06d9-41e3-8b60-6c5f4991a4a0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.027085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.027886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.028177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.028460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.029292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:51.029728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.031345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.050572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 82/162] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:51.055911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.146590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0fa34-9db2-4e01-926d-53983c6df6a3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.223559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.224880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.225363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.225937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.237662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.243047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7904e2-5864-4bbb-879b-d79bbf878847 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.251504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:51.270150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:51.271118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:51.271883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:51.275587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 81/163] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:51.281882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.298277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.317949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.318887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.319308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.319662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.325735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.327621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.329749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 83/164] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:51.336462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.471531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28d0c-3fcb-463d-9e6e-35bb1b6d4d09 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.545977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.547007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.547487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.547974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.548942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:51.549443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.550262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20711059-b1d5-4d16-ac71-28aa4a085d87 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.551633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.569549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 82/165] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:51.576299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.629670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.630443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.630727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.631001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.705477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.747736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:51.751644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.753152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d25976-2b31-4b06-8b01-bc5fc3399e30 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.852047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b032-31ea-48f5-9566-f7db7a21a1d4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:51.945600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:51.947216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.947216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.947495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] PATH_INFO: `/v3/users/574f3416e5e549e58ce2fb7218b67c18` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.949589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] RBAC: Authorizing `identity:get_user(user_id=574f3416e5e549e58ce2fb7218b67c18)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:51.953924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b7088-a8ad-45e1-ae03-1146ae9522c7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:51.953924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 83/166] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/users/574f3416e5e549e58ce2fb7218b67c18 => generated 275 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:51.959529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d276-2e9f-4a55-845c-d9e349260844 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.959816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d276-2e9f-4a55-845c-d9e349260844 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.960093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d276-2e9f-4a55-845c-d9e349260844 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:51.961546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 84/167] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:51.962351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659d276-2e9f-4a55-845c-d9e349260844 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:51.992725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 84/168] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:42:51.994423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:51.994954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:51.995430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.023504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:52.029923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:52.142869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:52.156227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 85/169] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:52.159946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.236459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659d276-2e9f-4a55-845c-d9e349260844 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.310164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.310902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.311164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.311430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.334284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:52.334964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e6bc-a25a-4d3f-b372-b0014c76f3e8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.372308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.373626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.374072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.374485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] PATH_INFO: `/v3/projects/5462f893203347c7a19505c6c6d00a4b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.375833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] RBAC: Authorizing `identity:get_project(project_id=5462f893203347c7a19505c6c6d00a4b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:52.377418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.379561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 86/170] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/projects/5462f893203347c7a19505c6c6d00a4b => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:52.380184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.435962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:52.437469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.455619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:52.492470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54692a-8cda-4ed1-8ea5-1dfdc92a7e7b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.532707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.533707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.534114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.534492 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.546643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:52.554715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:52.556037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:52.556893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 87/171] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:52.557544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.655218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 85/172] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:52.656588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.665720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a68f-0d73-45ae-8af3-ffb257d0c613 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.696398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:52.705503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.706355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.706711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.707064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.708149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=5462f893203347c7a19505c6c6d00a4b, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:52.708552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:52.710142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.717476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 88/173] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=5462f893203347c7a19505c6c6d00a4b&role.id=ba84795116f349709142360a12649701 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:52.722692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.755016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:52.887561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fa5c4-4384-4a15-84aa-72b2f72cef4d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.891877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db8a1-3aac-4d72-8925-b3699125bd27 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:52.930026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.930931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.931212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.931492 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.932747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:52.934299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.936221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 89/174] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:52.942293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:52.972502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:52.973123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:52.973413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:52.973695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:52.974502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:52.974818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:52.976312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:52.998114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 86/175] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:53.005052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.018308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.148017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca1ea1-5a72-4346-b187-026148eea01c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.189932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f980d2-07cd-4b81-8fc7-a7b826d42b70 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.194300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.228216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.228405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.229035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.229392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.229559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.230045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.230326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.234832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] PATH_INFO: `/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.235000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=574f3416e5e549e58ce2fb7218b67c18) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:53.235000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:53.235134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] RBAC: Authorizing `identity:get_user(user_id=8f14392ec7e347fab1ef8b6cbe7e2488)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:53.235200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238902f-9553-4b3e-8bb5-8280b658c692 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:53.235264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b267a1f-cb7d-4775-a626-407b4d9d0e30 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:53.235753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 87/176] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/users/8f14392ec7e347fab1ef8b6cbe7e2488 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:53.236831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958cfe-30b8-4bdc-b633-58e4be940052 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.237117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958cfe-30b8-4bdc-b633-58e4be940052 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.237395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958cfe-30b8-4bdc-b633-58e4be940052 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.239287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 88/177] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:53.240480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ed25-9257-43e4-8434-99693c623c70 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.241107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ed25-9257-43e4-8434-99693c623c70 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.241107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ed25-9257-43e4-8434-99693c623c70 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.242693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 89/178] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:53.243648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5ed25-9257-43e4-8434-99693c623c70 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.250324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 90/179] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:52 2022] GET /identity/v3/role_assignments?user.id=574f3416e5e549e58ce2fb7218b67c18&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:53.251780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519e5c5-0707-413d-bec2-1aa52ff67902 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.252109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519e5c5-0707-413d-bec2-1aa52ff67902 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.252397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519e5c5-0707-413d-bec2-1aa52ff67902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.283697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4519e5c5-0707-413d-bec2-1aa52ff67902 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:53.284993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4519e5c5-0707-413d-bec2-1aa52ff67902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:53.365794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5ed25-9257-43e4-8434-99693c623c70 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.406386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.407194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.407482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.407766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.412315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 91/180] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:53.413676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.414055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.414329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.444464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:53.445688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:53.455085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.486945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:53.489006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032669c-c6e8-422b-a218-e500908fdc64 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:53.521175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.552789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 92/181] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:53.553845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.621683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 90/182] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:53.624085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58337e1-7b3f-4f6c-9ab8-22535659f256 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.624703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58337e1-7b3f-4f6c-9ab8-22535659f256 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.625335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58337e1-7b3f-4f6c-9ab8-22535659f256 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.627128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 91/183] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:53.628305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58337e1-7b3f-4f6c-9ab8-22535659f256 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.695676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a036df-4284-4715-8304-ce60cc7d9ea7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.728263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.751495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.752346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.752704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.752993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.769279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58337e1-7b3f-4f6c-9ab8-22535659f256 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.770007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:53.778687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:53.779613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:53.780379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:53.782449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 93/184] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:53.783520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.814198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.815084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.815398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.815651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.826877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e593f078-97f2-4cd2-b243-d7dfa80de71c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:53.835017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:53.835897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:53.836800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:53.837453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:53.837524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 92/185] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:53.837524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.838437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.838437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.856068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:53.857277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:53.908224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941e1b-f539-43ab-bd69-74a1b4251943 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:53.929650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 93/186] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:53.933216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.955609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:53.956490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:53.956778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:53.957049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:53.958301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:53.959784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:53.965934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 94/187] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:53.965934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:53.998668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.041296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c9264-16ea-4d4a-aa85-dfa48ddf5303 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.069819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16eafe-d897-437a-8b58-1503fd6a79f8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.075535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.076276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.076493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.076770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.077535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:54.077837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.079266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.080877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.088074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 94/188] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.088912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.106441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.107138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.107415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.107692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.108470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:54.108780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.110242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.120098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 95/189] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:42:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.121022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.194509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadc862-33eb-4f51-ad51-e846b3ee8ddc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.217471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.227344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199223d5-28a4-48b0-a37c-7f592dabd108 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.229057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.229888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.230484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.231679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.233133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3b847-6785-4515-933c-b1837ca201a4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.234843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 95/190] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.236046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa258-d2f8-4a6e-bebe-9df5f2fbe5c5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.236334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa258-d2f8-4a6e-bebe-9df5f2fbe5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.236615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa258-d2f8-4a6e-bebe-9df5f2fbe5c5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.237841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 96/191] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:54.240624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa258-d2f8-4a6e-bebe-9df5f2fbe5c5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.267791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.268557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.268920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.269271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.270142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=8f14392ec7e347fab1ef8b6cbe7e2488) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:54.270465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.271926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.278778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 96/192] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/role_assignments?user.id=8f14392ec7e347fab1ef8b6cbe7e2488&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.279497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.320503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.377795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aa258-d2f8-4a6e-bebe-9df5f2fbe5c5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.404093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61735-5448-472f-a02f-f283a9e66157 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.416931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.417873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.418185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.418463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.436385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.437926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.439900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 97/193] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.440591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.451479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.452398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.452682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.452956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.454337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.455838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80138f-a48f-43ec-9802-cf686b1a9460 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.457587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 97/194] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:54.458936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.459228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.459508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.480995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:54.482250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:54.515628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.574321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 98/195] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:54.574321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.587896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3b2a2-baf7-4ade-bb25-d42dca8e47ff None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.607364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.628946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.629625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.630005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.630302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.631025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.632486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.674804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb7e2e-9a0f-48ad-8bb0-bd48e0bc4650 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.710054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.710715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.710947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.711392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.747076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 98/196] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:42:54 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:54.747076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:54.817507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:54.819132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:54.885511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329e05-54ff-4d70-a9e2-736131148fd1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:54.887944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.891245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:54.931489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:54.932166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:54.932454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:54.932735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:54.991081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 99/197] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:54.992285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.023712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.025347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.137813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa0e14-4a4d-4a52-b2a8-1da6ebad79a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.167313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 99/198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:55.168090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.171617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.200574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.202449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.203229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.203975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.208171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.226741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:55.244177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:55.246580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:42:55.248427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:55.253729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 100/199] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:55.259093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.274282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66be8-7be5-40a4-91e2-818923acdefb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.312355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.313234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.313516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.313786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.315087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.316624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.318386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 100/200] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.319268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.396259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.415653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e30-b084-4a8d-b799-5bc6ba87e39d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.428766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ad93-1ae6-41cb-8594-ae9ab079f76b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.469216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.470399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.470742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.471098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.472566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.474194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.476533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 101/201] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.477432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.479465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.481028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.482309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.482705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.483692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:55.484310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.485811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.496538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 101/202] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.501986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.570544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.612906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82fe5d-45af-4153-a217-813d1200d80c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.628789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6a301-2133-4d99-92d7-610dd2b4fcd5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.662617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.663173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.663458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.663749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.664596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=f9b69ca52ffd45c5b824515f55afcb9f) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:55.664911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.666487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.672770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.673802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.674309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.674778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.675853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=f9b69ca52ffd45c5b824515f55afcb9f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:55.676389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.678163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.678291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 102/203] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/role_assignments?user.id=f9b69ca52ffd45c5b824515f55afcb9f&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.679318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:55.682359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.693109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 102/204] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/role_assignments?user.id=f9b69ca52ffd45c5b824515f55afcb9f&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.903283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeef27-cdbd-41f6-8662-143812f215e9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:55.944545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:55.954203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:55.955098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:55.955382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:55.960989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] PATH_INFO: `/v3/users/4832baa6135b4e2e9fb2053ca40d0523` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:55.962897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] RBAC: Authorizing `identity:get_user(user_id=4832baa6135b4e2e9fb2053ca40d0523)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:55.964426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:55.966437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 103/205] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/users/4832baa6135b4e2e9fb2053ca40d0523 => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:55.972029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.104743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90779e-fe4b-477f-a639-88067ffbfc44 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.145372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.146067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.146355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.146636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.223626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.225054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.227205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.368471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 103/206] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:56.374636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.506938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aabfd2-3c52-40b8-bfe7-5952f62871a1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.560587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.561479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.561765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.562069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.563325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.564802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810128-927e-48b3-be11-85eb0ce3af55 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.566900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 104/207] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:56.572893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:56.716771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:56.720894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c7e67-7e09-40b2-9237-614ff8860dad None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:56.759358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:56.759953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:56.760238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:56.760514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:56.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2, user.id=4832baa6135b4e2e9fb2053ca40d0523) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:56.762253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:56.763824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7296-8b71-49bc-af06-6ae877407820 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:56.771154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 104/208] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:56 2022] GET /identity/v3/role_assignments?user.id=4832baa6135b4e2e9fb2053ca40d0523&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:57.366903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be898-596a-4237-9377-62da8bc9ba3d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.367770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be898-596a-4237-9377-62da8bc9ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.368231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be898-596a-4237-9377-62da8bc9ba3d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.370173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 105/209] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:57.377179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.377620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.378041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.400915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:57.402718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:57.505385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 105/210] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:57.532724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be898-596a-4237-9377-62da8bc9ba3d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:57.612278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:57.655424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be898-596a-4237-9377-62da8bc9ba3d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:57.692148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:57.693316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.693800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.694331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.695716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:57.697368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e6e25-a1d4-45fe-8b10-da51b78ed48b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:57.699613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 106/211] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:57.705279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:57.794160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aee04-cd01-4e12-aa2e-58d4e2ae232b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.794678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aee04-cd01-4e12-aa2e-58d4e2ae232b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.795332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aee04-cd01-4e12-aa2e-58d4e2ae232b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.800898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 107/212] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:57.802908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.803415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.803895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.806177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:57.815123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d0ef-36a8-4ca5-ad6b-5a8b5f82dbd2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:57.829173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:57.831400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:57.862245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:57.863765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:57.864093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:57.864937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:57.865921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:57.867881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:57.912869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 108/213] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:57.936955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:57.973919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 106/214] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:42:57 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:42:58.019278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:58.066404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64786e4e-1677-4ed8-8a4c-42537d6d0968 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.105567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.106475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.106767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.107047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.120677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ce28935a-d658-4b80-8d79-6d37522a1c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:58.129240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:58.130249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:58.131018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 109/215] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:58.139472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.253169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c968c-e5c8-4c5c-b882-62f9a48908d5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.266075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23b03-3ca2-4167-b5d5-e229bb8f1d4a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.266379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23b03-3ca2-4167-b5d5-e229bb8f1d4a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.266652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23b03-3ca2-4167-b5d5-e229bb8f1d4a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.269775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 110/216] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:58.276722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.277013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.277294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.294324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.294984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.295270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.295548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.296310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:58.296620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:58.297201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:58.298223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:58.298451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:58.308754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 107/217] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:58.314143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.329579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:58.401794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 111/218] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:42:58.428080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.467930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfe1b-7686-488b-8a77-aa240a9f3f4e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.500668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:58.526842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.528260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.529525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.530021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] PATH_INFO: `/v3/users/30d859bd1f504b7aaa405910902dc4b3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.555379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=30d859bd1f504b7aaa405910902dc4b3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:58.557240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:58.559769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 108/219] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/users/30d859bd1f504b7aaa405910902dc4b3 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:58.568135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.578204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9656689-23e7-4523-8917-9e95a67175ab None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.626489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.628210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.628769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.629194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.645183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:58.655379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:58.656308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:42:58.657116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:42:58.659452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 112/220] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:42:58.666134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.679339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:58.768162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541e7dc-7bb6-4b1a-8d0d-d99b718a5fa6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.780919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d5ad-5c87-4424-9da9-6cd2ae0caec2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.803081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:58.814402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.815404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.815976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.816485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.828500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:58.829193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.829460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.829736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.830535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:58.830843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:58.832252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b11d3d-3bbe-41ac-95d0-ea4c305308d8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:58.842448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 113/221] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:42:58.843796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028db597-9dba-4e20-8e02-6e886aaa7ad6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:58.849101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028db597-9dba-4e20-8e02-6e886aaa7ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:58.849416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028db597-9dba-4e20-8e02-6e886aaa7ad6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:58.851220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 114/222] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:42:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:42:58.851740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028db597-9dba-4e20-8e02-6e886aaa7ad6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:58.899185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:58.901283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:58.959432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028db597-9dba-4e20-8e02-6e886aaa7ad6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:58.977815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.002438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.003330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.003614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.009997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.009997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.009997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674f923-ff56-4ec0-b258-f956b4430ac4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.009997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 115/223] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.014294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.014588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.014926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.022307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 109/224] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:42:59.023177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.033420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:42:59.034592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:42:59.078381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.114627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 116/225] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:42:59.115831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.144239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a05b6-b2e2-4bb1-876c-b10dd60472a5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.182750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.183674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.183958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.184236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.185781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.187443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.189493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 110/226] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.194409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.233142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.235389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17be59-8e7b-4d56-a688-6fb98efb934c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.271944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.273095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.273526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.273993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.275380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.277550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.279826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 117/227] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.280823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.306251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c77bab-20b8-4590-b191-2e58752a3dfd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.324503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.345108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.346370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.347004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.347363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.362209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:42:59.372222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:42:59.373656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:42:59.374731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:42:59.376301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 111/228] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:42:59.377174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.396135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d17a-4a29-4bd6-888d-c4374100cb4f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.442877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.443887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.444238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.444583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/users/f9b69ca52ffd45c5b824515f55afcb9f/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.447557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, user_id=f9b69ca52ffd45c5b824515f55afcb9f, role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.450110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.497291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.503727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33034f-4f76-46a7-81f0-e195f91ecbd9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.538643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 118/229] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:42:59 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/users/f9b69ca52ffd45c5b824515f55afcb9f/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:42:59.540253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.559978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.561120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.561884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.562517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.565664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=30d859bd1f504b7aaa405910902dc4b3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:59.566451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.569090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.583558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 112/230] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/role_assignments?user.id=30d859bd1f504b7aaa405910902dc4b3&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=ba84795116f349709142360a12649701 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.709096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:42:59.713218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70fd7-7780-41bc-b7a2-985e5405a423 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.773646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.774394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.774678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.774958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.775771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:42:59.776261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.777942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.800402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 119/231] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.806472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:42:59.927617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0dfb-ce0f-4e69-ac08-f501501f72cf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:42:59.965393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:42:59.966764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:42:59.967269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:42:59.967745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:42:59.969171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:42:59.970993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:42:59.973236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 113/232] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:42:59.981602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.089646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d64e7-f7f1-4cb5-8c50-cba9a1739662 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.135711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.136695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.136981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.137310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.138576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.140102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696526b6-5f9a-4a0c-b19b-3ae647bb9ab5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.142932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 120/233] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:42:59 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:00.147601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:00.190429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:00.266239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9806-ce26-4c04-9fdf-5fc7d577a100 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:00.302757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:00.303652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.303930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.304199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/users/f9b69ca52ffd45c5b824515f55afcb9f/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.306311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, user_id=f9b69ca52ffd45c5b824515f55afcb9f, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:00.308368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b453d6-118e-4039-af95-4b4c5a19314a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:00.392363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 114/234] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:00 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/users/f9b69ca52ffd45c5b824515f55afcb9f/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:00.995410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e89-aaeb-4581-8c22-bb6782b26485 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.995921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e89-aaeb-4581-8c22-bb6782b26485 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.995994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e89-aaeb-4581-8c22-bb6782b26485 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:00.999136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ab66-dc1e-419c-910b-3492a7ca92b9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:00.999544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ab66-dc1e-419c-910b-3492a7ca92b9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:00.999724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456ab66-dc1e-419c-910b-3492a7ca92b9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.001037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 115/235] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:01.001648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 121/236] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:01.006979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.007329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.007431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.007624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.007718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.007909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.027220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:01.028440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:01.036256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:01.038571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:01.054600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.101460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 122/237] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:01.125969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.168474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 116/238] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:01.214507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.239849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c768ddc-715f-49a6-9435-41592b1cc021 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.254237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.285164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.286188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.286580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.286987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.299122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:01.313165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:01.314119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:01.314906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 123/239] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:01.319566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.354341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.434494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bed5d8-dded-46ca-9714-dff2bc759e77 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.472868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.473562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.473850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.474164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.474943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:01.475557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.477087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.487204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 124/240] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:01.492253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c0b2-de6d-4936-978f-a739c32812d9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.492670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.606419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.610965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaffb6-ebec-406a-9f04-517f3bfc2d67 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.620970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.621775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.633694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.633694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.633694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.633694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.636469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 117/241] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:01.639348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.707212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.708121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.708403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.708682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] PATH_INFO: `/v3/users/3420f95fb05d47c3a0585811162a36f7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.739286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3420f95fb05d47c3a0585811162a36f7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.740789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.742933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 125/242] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/users/3420f95fb05d47c3a0585811162a36f7 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:01.756050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:01.758579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:01.770867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286625d-b7ed-4d3f-a8b0-362d91eabb73 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.813715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.814452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.814742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.815024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.815756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:01.817379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:01.914352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb2d6-8634-45c2-adea-850efa0376e4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:01.950376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:01.951049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:01.951334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:01.951611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:01.961511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:02.029233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:02.033128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:02.044063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 118/243] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:01 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:02.169844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 126/244] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:02.179141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:02.359408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d45fa9-d6b3-46af-bfb1-334c5607ddef None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:02.396897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:02.398228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.398720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.399196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.400819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:02.402743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3dff-ec1e-4be2-bd32-0aa34af9c568 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:02.405395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 119/245] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:02 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:02.410923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:02.464850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:02.534583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f49ef-06fe-4f00-a6f4-293375e63e3d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.534893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f49ef-06fe-4f00-a6f4-293375e63e3d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.535149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f49ef-06fe-4f00-a6f4-293375e63e3d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.535389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe2d-a6af-4c5a-b83e-d462483bda4a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:02.536535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 120/246] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:02.543729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad03d0-6297-4222-9492-2cec0d454b13 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.543729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad03d0-6297-4222-9492-2cec0d454b13 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.543729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad03d0-6297-4222-9492-2cec0d454b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.572778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cdad03d0-6297-4222-9492-2cec0d454b13 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:02.575153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cdad03d0-6297-4222-9492-2cec0d454b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:02.576690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:02.577598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.578123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.578615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.579663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=3420f95fb05d47c3a0585811162a36f7) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:02.580185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:02.581911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:02.582250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:02.589341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 127/247] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:02 2022] GET /identity/v3/role_assignments?user.id=3420f95fb05d47c3a0585811162a36f7&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:02.661413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 121/248] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:02.689129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:02.807671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c802-009d-4805-b7f4-7948d922b0a9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.808318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c802-009d-4805-b7f4-7948d922b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.808825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c802-009d-4805-b7f4-7948d922b0a9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.812195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 122/249] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:02.818353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.819006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.819507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.827426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4c44-df80-4df4-9900-d545c94f84ff None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:02.829184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:02.841418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:02.842927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:02.867117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:02.867941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:02.868232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:02.868521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:02.881800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:02.892550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:02.893701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:02.894754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 128/250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:02.902306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:02.988787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 123/251] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:03.014614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.020787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d304907-3f3d-416e-a59c-cb2deb6fabff None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.058116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.059873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.060353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.060921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.062777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:03.063594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.066658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.077569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 129/252] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:03.082966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.112987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:03.191514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e69be-fbee-47b9-8497-cc5f68993587 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.219797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:03.232539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.233733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.234223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.234705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] PATH_INFO: `/v3/users/30d859bd1f504b7aaa405910902dc4b3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.236149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] RBAC: Authorizing `identity:get_user(user_id=30d859bd1f504b7aaa405910902dc4b3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.237929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.240155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 130/253] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/users/30d859bd1f504b7aaa405910902dc4b3 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:03.247416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.280128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051ec4-b795-4477-8748-0c9c33e018b5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.338661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.340278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.340727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.341219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.360895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4e3e9db1-3797-4565-98a0-689b5dbf29d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:03.372404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:03.373605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:03.374415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:03.382250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 124/254] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:03.386127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c0b43-c847-485a-b1d1-47c75ee4aa40 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.387813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c0b43-c847-485a-b1d1-47c75ee4aa40 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.388940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c0b43-c847-485a-b1d1-47c75ee4aa40 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.393091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 125/255] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:03.393915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c0b43-c847-485a-b1d1-47c75ee4aa40 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.414863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:03.427605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8fd6-599f-4816-b865-c8ba5de69441 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.494215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.495735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.496014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.496289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.499444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.502408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b42a-b1ef-423f-81e3-8bc48ae0e74b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.507608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 131/256] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:03.510334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.511201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.511485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.547920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:03.550676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:03.586134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c0b43-c847-485a-b1d1-47c75ee4aa40 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.632121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:03.639983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.643279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.643279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.643279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.643279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:03.643279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.643837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.653861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 126/257] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:03.654760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.723890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 132/258] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:03.724900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.764808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815801e-e7ee-47fa-8610-658bb15ae7b5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.803706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.804657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.804940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.805214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/users/30d859bd1f504b7aaa405910902dc4b3/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.807255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, user_id=30d859bd1f504b7aaa405910902dc4b3, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.809381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.884284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:03.893978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7b602-476d-4884-8e96-e27ffdeab2e6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:03.901430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 127/259] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:03 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/users/30d859bd1f504b7aaa405910902dc4b3/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:03.902320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:03.951362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:03.952282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:03.952565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:03.953529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:03.954971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:03.956558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:03.958396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 133/260] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:03.964154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.068017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.134610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b59670-19fb-4f23-b4c1-eeb0d72123e4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.175725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.176744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.177340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.177832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.208586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.214630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4cacc-ac17-4a7d-8808-d34bc30989a2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.259179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:04.261082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:04.292280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.293230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.293452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.293711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.319655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:04.332389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:04.333370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:04.339237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 128/261] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:04.358984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.385736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 134/262] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:43:04.395065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.489709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.601965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3a68-3916-4585-823a-25b6f7c8de03 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.613304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1513e5-58e8-49af-a19f-2834a59533e1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.637410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.688410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.689486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.689995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.690470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.691427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:04.691925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:04.693535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:04.704525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.706097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.706672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.707190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.708612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 129/263] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:04.715401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:04.717753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:04.720053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 135/264] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:04.720501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.725772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:04.936373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e777-9b45-4961-adea-1d09dfec76bf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.941337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7f58-a156-4d07-a4b7-6c07607317b4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:04.975794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:04.980541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:04.981313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:04.981603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:04.981884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:04.982766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=f9b69ca52ffd45c5b824515f55afcb9f) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:04.983082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:04.984558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:04.991764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 136/265] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/role_assignments?user.id=f9b69ca52ffd45c5b824515f55afcb9f&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:05.020308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.021311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.021677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.021984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] PATH_INFO: `/v3/users/f9b69ca52ffd45c5b824515f55afcb9f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.027007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] RBAC: Authorizing `identity:get_user(user_id=f9b69ca52ffd45c5b824515f55afcb9f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.028807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.031261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 130/266] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:04 2022] GET /identity/v3/users/f9b69ca52ffd45c5b824515f55afcb9f => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:05.036797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.177320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1ef1-6880-4d2c-84e7-0426378ffd64 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.224058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.224660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.224943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.225220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.309480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.322158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.323707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.469947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 137/267] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:05.476698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.552151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.629722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a6274-9f76-4cb2-98a6-e91de6c5b5fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.670111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.670995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.671281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.671558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.672832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.674336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ccc44-367f-4a91-8a34-dddf6b2bdfea None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.676079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 131/268] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:05.682190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.725462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f331-f81d-49e0-ada2-3fa7c5e810be None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.725763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f331-f81d-49e0-ada2-3fa7c5e810be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.726055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f331-f81d-49e0-ada2-3fa7c5e810be None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.727808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 132/269] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:05.734657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.734945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.735232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.760812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:05.762042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:05.834475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:05.856662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2690f-b152-47d3-98c5-eca42da686f7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:05.881035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 133/270] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:05.908405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:05.926681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:05.927731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:05.928254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:05.928729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:05.929774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=f9b69ca52ffd45c5b824515f55afcb9f) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:05.930311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:05.931988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14d89-0d5a-4d01-b3a4-8d67f562fb89 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:05.939063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 138/271] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/role_assignments?user.id=f9b69ca52ffd45c5b824515f55afcb9f&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:05.960959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.029566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bb017-04e0-4273-80e9-7182b14b0a56 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.030471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b27e-1bfd-444f-a3f1-27673585f6b6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.030970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b27e-1bfd-444f-a3f1-27673585f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.031513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b27e-1bfd-444f-a3f1-27673585f6b6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.048012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 139/272] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:06 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:06.054290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.054624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.054875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.070055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.070883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.071168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.071447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.073924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:06.075529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:06.084928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:06.093597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:06.094604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:06.095393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:06.099921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 134/273] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:06.101454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.164327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 140/274] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:06.199966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.219411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.222409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f39a-290b-4ca5-8f08-a4e31fb0a48d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.260151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.261478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.267567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.267942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.268919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:06.269400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.271029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32b12a-c3ac-4049-a4ac-dbd88ccfd6db None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.286254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 135/275] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.287846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7281a0-9294-46e0-ad6e-ca6a03f6f3a0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.288225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7281a0-9294-46e0-ad6e-ca6a03f6f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.288558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7281a0-9294-46e0-ad6e-ca6a03f6f3a0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.290639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 136/276] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:06.291741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7281a0-9294-46e0-ad6e-ca6a03f6f3a0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.356034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.377918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2efe36-7d8c-4b35-8a9b-7d91aebee833 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.412443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7281a0-9294-46e0-ad6e-ca6a03f6f3a0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.422678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.423494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.423783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.424059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.436741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-cd16f736-db29-4bf8-af3c-731092cc2d8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:06.444648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:06.445538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 141/277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:06.452120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.452828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.452828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.463375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.464283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.464564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.464829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] PATH_INFO: `/v3/users/d2280bf4f02f4abfb6284ae82a0646a7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.468596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:06.469673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:06.483761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] RBAC: Authorizing `identity:get_user(user_id=d2280bf4f02f4abfb6284ae82a0646a7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.485357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.487233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 137/278] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/users/d2280bf4f02f4abfb6284ae82a0646a7 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:06.488097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.514549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.556831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 142/279] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:06.558819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.620331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85a7b-457c-4c94-b0f6-8b6747db2d27 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.659391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.660065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.660664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.660664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.661374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:06.661681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.663121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.663584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.672972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 138/280] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.673597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.696040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e438-f736-4636-b663-a0d17d74cb4a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.738373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.739088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.739400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.739760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.740654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, user.id=d2280bf4f02f4abfb6284ae82a0646a7, scope.system=all) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:06.740965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.742597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.757992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 143/281] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/role_assignments?user.id=d2280bf4f02f4abfb6284ae82a0646a7&scope.system=all&role.id=ba84795116f349709142360a12649701 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.757992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.779815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:06.826294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22a322-ae70-4af0-92c7-9badf04ab1d3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.878958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.880460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.880747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.881027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.882525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.884720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.887314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 139/282] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.893004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.921175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c4fbe-f266-44b4-88a7-16898a229cc4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:06.967736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:06.968846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:06.969235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:06.969616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] PATH_INFO: `/v3/users/3420f95fb05d47c3a0585811162a36f7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:06.971099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=3420f95fb05d47c3a0585811162a36f7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:06.972774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:06.979536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 144/283] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/users/3420f95fb05d47c3a0585811162a36f7 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:06.981772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:06.992665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:07.039366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773417-9a56-4379-80e0-7d4e0c5b00cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.089127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.090385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.091499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.091964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.092875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:07.095606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b89b2a-d9fe-45ef-a1d4-eb5b675803e9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:07.124667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d7b7-2ab4-474f-9450-344162973ea7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.164384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.165323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.165610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.165885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.167715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:07.169166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:07.170925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 145/284] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:06 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:07.176952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:07.242637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 140/285] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:06 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:07.245656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651ed2-319e-47d7-a6ba-8557575e7465 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.246609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651ed2-319e-47d7-a6ba-8557575e7465 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.248010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651ed2-319e-47d7-a6ba-8557575e7465 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.251974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 141/286] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:07.261473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.262139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.262635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.273356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:07.284249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:07.293015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:07.295095 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:07.305048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19433b3-0fa3-4228-8c33-9413706b0af4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.346247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.347110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.347390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.347663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/users/3420f95fb05d47c3a0585811162a36f7/roles/464de7ac8e1e447ab1e5c98a963b867e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.349877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, user_id=3420f95fb05d47c3a0585811162a36f7, role_id=464de7ac8e1e447ab1e5c98a963b867e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:07.351470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:07.406860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 142/287] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:07.436793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:07.446154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 146/288] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:07 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/users/3420f95fb05d47c3a0585811162a36f7/roles/464de7ac8e1e447ab1e5c98a963b867e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:43:07.566146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12120f-b7e3-4c7b-9879-fd15813098ef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.607525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.608285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.608570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.608843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.612525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:07.623174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:07.631520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:07.632552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:07.633325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:07.633988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 143/289] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:07.640107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:07.763066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce44fb-3bd8-47f5-96a4-3830bf8e364d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:07.806935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:07.807649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:07.807934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:07.808213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:07.808979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:07.809293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:07.810880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:07.812487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:07.821422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 147/290] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:07.827578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:07.951868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9fd3-d60c-4b0f-8813-8d28c6f73aa5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:08.001625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:08.002551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:08.002835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:08.003114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] PATH_INFO: `/v3/users/30d859bd1f504b7aaa405910902dc4b3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:08.004502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] RBAC: Authorizing `identity:get_user(user_id=30d859bd1f504b7aaa405910902dc4b3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:08.006000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:08.007695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 144/291] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:07 2022] GET /identity/v3/users/30d859bd1f504b7aaa405910902dc4b3 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:08.014733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:08.141180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837935b-4825-4137-8af1-17ed12268de6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:08.187535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:08.188202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:08.188483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:08.188754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:08.254629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:08.265278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:08.266823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:08.381040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 148/292] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:08.386776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:08.474151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:08.517035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06e7c-5199-4ee5-aa22-6a0d5ce79631 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:08.559573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:08.560693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:08.561148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:08.561571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:08.562963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:08.564588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322aa6-8289-4ddd-8f9c-f03e881b2483 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:08.566593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 145/293] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:08 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:08.572496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:08.700167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:08.710444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0980-b8cf-438e-9e4b-efc6db1b1491 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:08.758261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:08.759220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:08.759659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:08.760125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:08.761616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=30d859bd1f504b7aaa405910902dc4b3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:08.762101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:08.763700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e2571-d1cb-4b77-bb71-b42364975e8b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:08.775450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 149/294] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:08 2022] GET /identity/v3/role_assignments?user.id=30d859bd1f504b7aaa405910902dc4b3&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=ba84795116f349709142360a12649701 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:09.455927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e2f-d5dd-44ad-8a9d-54d8dea6d21e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.456458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e2f-d5dd-44ad-8a9d-54d8dea6d21e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.456879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384e2f-d5dd-44ad-8a9d-54d8dea6d21e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.458769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 146/295] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:09.465010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.465975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.466460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.489583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:09.491163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:09.571843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 150/296] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:09.595038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384e2f-d5dd-44ad-8a9d-54d8dea6d21e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:09.723120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384e2f-d5dd-44ad-8a9d-54d8dea6d21e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:09.758093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:09.763975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:09.769525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.769525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.769525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.778407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:09.786557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:09.788051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:09.788875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:09.792950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 147/297] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:09.799176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:09.900236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:09.913597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e13eee-39b4-4118-8dac-1f6dd0e9f77a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:09.958529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:09.959467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:09.959753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:09.960032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:09.960988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:09.961296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:09.962976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53b40-ac6b-4823-a276-4e84b009e819 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:09.981092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 151/298] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:09.982469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.070040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010db8-b088-4684-9529-be204fc2efa8 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.070381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010db8-b088-4684-9529-be204fc2efa8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.070617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010db8-b088-4684-9529-be204fc2efa8 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.072010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 152/299] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:10.078147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.078439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.078732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.096382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:10.097570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:10.121054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102197f-8bd9-4a98-99b3-e8f97639bd82 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.166937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.168124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.168483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.169121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] PATH_INFO: `/v3/users/d2280bf4f02f4abfb6284ae82a0646a7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.170378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] RBAC: Authorizing `identity:get_user(user_id=d2280bf4f02f4abfb6284ae82a0646a7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.172380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.174351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 153/300] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:10.178104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 148/301] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:09 2022] GET /identity/v3/users/d2280bf4f02f4abfb6284ae82a0646a7 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.186725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.200519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.280287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.289159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.308351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c653b-d147-45c9-9180-e09e225d4eca None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.335583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f97c-bc0e-4f60-8945-8e490fe8578d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.346188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.347514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.348520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.348803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] PATH_INFO: `/v3/system/users/d2280bf4f02f4abfb6284ae82a0646a7/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.350644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d2280bf4f02f4abfb6284ae82a0646a7, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.352044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10394efe-cd13-451d-afc3-c114e3b01e8b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.382323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.383116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.383399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.383674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.394331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-be313b51-8832-4192-9b5f-c88e321b2d1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:10.402094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:10.403342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:10.404247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 149/302] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:10.404928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6bc0-ee9f-49f3-ae3a-f0d9d86be439 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.405209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6bc0-ee9f-49f3-ae3a-f0d9d86be439 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.405484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab6bc0-ee9f-49f3-ae3a-f0d9d86be439 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.408433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 150/303] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:10.408433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc4bf-8af2-4c28-a316-98bf969e56e0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.408433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc4bf-8af2-4c28-a316-98bf969e56e0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.408433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dc4bf-8af2-4c28-a316-98bf969e56e0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.409656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 151/304] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:10.410383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dc4bf-8af2-4c28-a316-98bf969e56e0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.453978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 154/305] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 31 20:43:10 2022] PUT /identity/v3/system/users/d2280bf4f02f4abfb6284ae82a0646a7/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:10.455545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeddbb-7253-4dbe-b33d-59e6650b154f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.455910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeddbb-7253-4dbe-b33d-59e6650b154f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.456261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeddbb-7253-4dbe-b33d-59e6650b154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.486122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bbeeddbb-7253-4dbe-b33d-59e6650b154f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:10.488306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bbeeddbb-7253-4dbe-b33d-59e6650b154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:10.539905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dc4bf-8af2-4c28-a316-98bf969e56e0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.569686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.581058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 155/306] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:10.582202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.586142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.586142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.590907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.591601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.591887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.592162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.592944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:10.593255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.594731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.605536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 152/307] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.606528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.609119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:10.612321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:10.705834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 156/308] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:10.710921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.720730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.740386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe88e-2325-4f58-8490-ff93e3f946a5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.786001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.787151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.787625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.787901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.792090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.792090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.797847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 153/309] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.797847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.837436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0a51c-42d9-4318-8fae-dc2693cac9af None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.852318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.879819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.883609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.883609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.883609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] PATH_INFO: `/v3/users/3420f95fb05d47c3a0585811162a36f7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.883609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] RBAC: Authorizing `identity:get_user(user_id=3420f95fb05d47c3a0585811162a36f7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:10.884064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:10.890104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 157/310] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/users/3420f95fb05d47c3a0585811162a36f7 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:10.890104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:10.917621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7fcb9-9157-4f5c-a64e-7ea74883fdae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:10.958683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:10.959495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:10.959815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:10.960058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:10.972502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:10.978361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:10.982159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:10.983115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:10.983936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 154/311] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:10.984608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.013523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d2f8-e57b-4c79-9273-ae86f678ec45 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.049997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.050663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.050967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.051303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] PATH_INFO: `/v3/groups` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.052032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.053542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.095792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8d3c9-75a4-41fd-ba3c-e274541d78f0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.128958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.130347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.130347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.130347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.200207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.201679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.206550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.285182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 158/312] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 31 20:43:10 2022] POST /identity/v3/groups => generated 229 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:11.286347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.323403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 155/313] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:11.330732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.366142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.424828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1fc8d-e49f-4890-9968-6ec0bc5493af None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.471688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.472388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.472674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.472953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.474314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:11.474628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.476561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.478448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.491191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 159/314] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:11.498025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.499609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad3511-ca34-47a3-99b5-7cc2d580c1ee None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.550128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.551014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.551291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.551563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.552799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.554356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.556080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 156/315] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:11.562000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.631213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e35bd-ec28-446a-b375-121a8a14f112 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.657114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.684393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.685282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.685566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.685930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] PATH_INFO: `/v3/users/0bfe4e0556674ef0a832fd101f3f603c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.686853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb7d74-05f5-407a-a997-6c06d0d76085 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.701609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfe4e0556674ef0a832fd101f3f603c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.703150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.705237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 160/316] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/users/0bfe4e0556674ef0a832fd101f3f603c => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:11.711439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:11.737130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.737863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.738241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.739118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.740131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, scope.project.id=3ec648ba8e024846bac298ee23998c07, user.id=3420f95fb05d47c3a0585811162a36f7) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:11.740588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.742451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612362-189d-4080-91d9-b1c7a1698d5f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.752753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 157/317] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/role_assignments?user.id=3420f95fb05d47c3a0585811162a36f7&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:11.792364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:11.843929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d6d1-6eba-4ab7-a955-f836644800d4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:11.892342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:11.892952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:11.893239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:11.893514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:11.894414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, user.id=0bfe4e0556674ef0a832fd101f3f603c, scope.system=all) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:11.894730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:11.896209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a8b1-ba51-44f2-b79d-394e1e1b23a0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:11.903573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 161/318] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 31 20:43:11 2022] GET /identity/v3/role_assignments?user.id=0bfe4e0556674ef0a832fd101f3f603c&scope.system=all&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:12.844082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdf7d-487b-4b6b-85d0-df2cc2e54141 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:12.844675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdf7d-487b-4b6b-85d0-df2cc2e54141 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:12.844675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffdf7d-487b-4b6b-85d0-df2cc2e54141 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:12.846249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 158/319] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:12.851524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:12.851942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:12.852124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:12.868618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:12.869849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:12.938349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 162/320] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:12.962920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffdf7d-487b-4b6b-85d0-df2cc2e54141 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:13.075797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffdf7d-487b-4b6b-85d0-df2cc2e54141 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:13.119381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:13.120294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.120688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.120979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.132039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:13.140311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:13.141183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:13.142090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 159/321] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:13.147704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:13.199720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:13.253450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513bf0-8f65-4f8b-a95d-6b5d126ad7c9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:13.289145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:13.289856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.290175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.290450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.291233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:13.291539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:13.293017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:13.301821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 163/322] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:13.307879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:13.310902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:13.428151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158dea-cd6d-4827-a8cd-8dd66d1edf0e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:13.465462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:13.466357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.466640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.466914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] PATH_INFO: `/v3/users/d2280bf4f02f4abfb6284ae82a0646a7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.468195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d2280bf4f02f4abfb6284ae82a0646a7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:13.469650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c047cf-6764-4e25-bb40-9cbd85d661c4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:13.471540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 160/323] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:13 2022] GET /identity/v3/users/d2280bf4f02f4abfb6284ae82a0646a7 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:13.476999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:13.586934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c41cd-4178-45da-b69f-a91d9bbb1c17 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:13.598025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:13.622638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:13.623301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.623628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.623956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.624789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] RBAC: Adding query filter params (role.id=ba84795116f349709142360a12649701, user.id=d2280bf4f02f4abfb6284ae82a0646a7, scope.system=all) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:13.625097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:13.626690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddd8f-b93e-4c41-822e-7ce2de4118c5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:13.640132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 164/324] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 31 20:43:13 2022] GET /identity/v3/role_assignments?user.id=d2280bf4f02f4abfb6284ae82a0646a7&scope.system=all&role.id=ba84795116f349709142360a12649701 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:13.686862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b77c-6d69-4d38-b8ec-95d37b176ba6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.687184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b77c-6d69-4d38-b8ec-95d37b176ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.687440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b77c-6d69-4d38-b8ec-95d37b176ba6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.689028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 161/325] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:13.694609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.694896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.695185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.713479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:13.714801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:13.801014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 165/326] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:13.824470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b77c-6d69-4d38-b8ec-95d37b176ba6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:13.909190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:13.941620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b77c-6d69-4d38-b8ec-95d37b176ba6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:13.975449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:13.976241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:13.976519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:13.976792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:13.977977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:13.980091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87677e51-a6e9-4176-9249-cd8b1fc2f2a4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:13.981705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 162/327] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:13.987319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.085394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:14.089977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aba09-b3ec-42a5-a762-23592b7a84b6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.125234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.125924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.126210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.126484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] PATH_INFO: `/v3/groups` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.127176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:14.128618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:14.196911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0ccd-5b3f-484d-bdef-82e6f3bbad2e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.197190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0ccd-5b3f-484d-bdef-82e6f3bbad2e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.197459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b0ccd-5b3f-484d-bdef-82e6f3bbad2e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.198892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 163/328] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:14.203683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.203963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.204258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.221333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:14.222574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:14.262920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 166/329] 10.222.0.55 () {60 vars in 1134 bytes} [Tue May 31 20:43:13 2022] POST /identity/v3/groups => generated 226 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:14.291884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 164/330] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:14.314335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.429829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a944bf-42b5-4736-8015-53c47b20fe9d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.466870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.467597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.467876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.468149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.480038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:14.487956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:14.488893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:14.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 167/331] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:14.498727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.570296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:14.605868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ecdf-4b2a-42f0-a5ba-6dcf64afa8d4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.647531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.648245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.648520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.648830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.649574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:14.649914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:14.652054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:14.661432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 165/332] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:14.667281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.690627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:14.799022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629ba61-e280-4ff2-a57a-63ad2488379f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:14.841530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:14.842864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:14.843355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:14.843842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] PATH_INFO: `/v3/users/0bfe4e0556674ef0a832fd101f3f603c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:14.845407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfe4e0556674ef0a832fd101f3f603c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:14.847205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35862-d8db-47ab-88a3-45ea0d19ab71 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:14.849240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 168/333] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:14 2022] GET /identity/v3/users/0bfe4e0556674ef0a832fd101f3f603c => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:14.855761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:14.975863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535c1e0-a7e8-4684-9263-801cfed9c010 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:15.007615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:15.019641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:15.020548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:15.022271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:15.022271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] PATH_INFO: `/v3/system/users/0bfe4e0556674ef0a832fd101f3f603c/roles/464de7ac8e1e447ab1e5c98a963b867e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:15.022673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0bfe4e0556674ef0a832fd101f3f603c, role_id=464de7ac8e1e447ab1e5c98a963b867e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:15.024079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e2efe-b722-42b6-9ad8-95a1b738b702 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:15.189043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 166/334] 10.222.0.55 () {58 vars in 1334 bytes} [Tue May 31 20:43:14 2022] PUT /identity/v3/system/users/0bfe4e0556674ef0a832fd101f3f603c/roles/464de7ac8e1e447ab1e5c98a963b867e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:17.272196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b1ac-993c-44b7-8492-9d0493e5e42a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.272748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b1ac-993c-44b7-8492-9d0493e5e42a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.272841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b1ac-993c-44b7-8492-9d0493e5e42a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.274828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 169/335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:17.280403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.280942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.281016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.305845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:17.307730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:17.392294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 167/336] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:17.432538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b1ac-993c-44b7-8492-9d0493e5e42a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:17.544822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:17.565788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b1ac-993c-44b7-8492-9d0493e5e42a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:17.609442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:17.610310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.610603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.610886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.625245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-bfeb96bc-c5dc-49c8-a701-2e1203f821d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:17.637235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:17.638272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:17.639073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 170/337] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:17.644382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:17.691813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e790-3664-4a2f-a8d0-5042b7fef0ef None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.692156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e790-3664-4a2f-a8d0-5042b7fef0ef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.692384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e790-3664-4a2f-a8d0-5042b7fef0ef None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.693801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 171/338] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:17.699687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.699995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.700254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.744630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:17.744630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:17.812123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e72b8c-bc64-4636-92b7-4c693151f3b3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:17.862270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:17.872302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:17.872983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:17.873264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:17.873576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:17.877869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:17.879000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:17.880717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:17.895934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 168/339] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:17.901716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 172/340] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 31 20:43:17.904785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:17.957885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.055347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb13cf-2ebc-4a94-b3d5-3bf285ef8d43 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.107764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.115923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.116598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.116880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.117146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.139465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09e037-34a8-46cc-9e62-55beb1f247b9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.178437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.179265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.179551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.179824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.199693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:18.205272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3a558923-c6de-410c-86e6-71cdaf616367 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:18.208667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:18.209549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:18.217459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 173/341] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:18.219663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62a7a-1294-4ea9-9e80-7715c7f140ec None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.220110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62a7a-1294-4ea9-9e80-7715c7f140ec None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.220530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62a7a-1294-4ea9-9e80-7715c7f140ec None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.221008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:18.223049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b54ce-2a4a-4c2e-9d2e-945ab45ef3a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:18.223593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 174/342] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:18.224910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82aa0-cabe-4567-a193-92e1b357aefa None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.225339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82aa0-cabe-4567-a193-92e1b357aefa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.225760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef82aa0-cabe-4567-a193-92e1b357aefa None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.227171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 175/343] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:18.228144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef82aa0-cabe-4567-a193-92e1b357aefa None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.359039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef82aa0-cabe-4567-a193-92e1b357aefa None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.368328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 169/344] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:43:18.368867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.374538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.374945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.399684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:18.401833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:18.413601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.414567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.415018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.415437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.416369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:18.416819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:18.418385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee849-dad1-40f1-9cda-b1c1a872f5c8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:18.421413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.432961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 176/345] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:18.435232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.435232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.435538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.460519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:18.462018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:18.495355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 170/346] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:18.495355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.532623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.563293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 177/347] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:18.564424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.651933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94894e8e-c5a3-4d02-bcb9-c881b41a19a9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.686934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d92548-c887-4597-b8c1-f07bc6ea1041 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.695655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.696569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.698132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.698132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.702905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:18.703610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:18.705487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 171/348] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:18.706389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.722274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.734609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.735177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.735557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.735889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.824173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:18.825672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:18.836370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:18.843465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a58-344c-4566-a4f8-ec9c3de80d60 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:18.882253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:18.883408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:18.885398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:18.885820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:18.898535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:18.907672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:18.908726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:18.909692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:18.911973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 172/349] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:18.912963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.948697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 178/350] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:18.948899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:18.987504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.033003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4d720-13a6-47f4-97b3-e81976f40008 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.070189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.071319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.071777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.072757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.076723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4911-0c5a-4fa3-be67-5245301afe69 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.084981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:19.097308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:19.098276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:19.099077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:19.100400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 173/351] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:19.102264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.116113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.121581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.122749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.123027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.123297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.130519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.131986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.134997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 179/352] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:18 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.135106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.232193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee468cb-53d8-4472-b26e-b1b3a677718c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.268467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.276630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.277406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.277779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.277924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed4e0-0a1e-4ed0-aa5e-a39288c8ad62 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.278016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.283626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:19.283626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.283626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.290144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 174/353] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.291122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.320638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.321518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.322478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.322824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.324803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.326282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.328080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 180/354] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.328864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.384154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.435927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22384cb2-ff9c-4e85-9e41-c9447cd44320 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.457878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae320a8-1491-4173-8804-e2bf6e193a1d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.495828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.497278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.497783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.498341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.499745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:19.500090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.502421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.502726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.503088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.503375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.503657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.504504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:19.504822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.508963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de54eb-7ac6-4d4c-8674-24c502a51aee None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.512911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 181/355] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.514338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee90-a95e-46d4-9742-d2ca4b3c8c41 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.514630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee90-a95e-46d4-9742-d2ca4b3c8c41 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.514913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee90-a95e-46d4-9742-d2ca4b3c8c41 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.516394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 182/356] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:19.517565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd62-a546-435c-b827-078c37b39474 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.517852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd62-a546-435c-b827-078c37b39474 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.518173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd62-a546-435c-b827-078c37b39474 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.519637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 183/357] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:19.520448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8dd62-a546-435c-b827-078c37b39474 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.522737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 175/358] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.526280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.555387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.676996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f795b7c-2627-4c55-9df1-375776f29e5a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.677673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8dd62-a546-435c-b827-078c37b39474 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:19.722954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.723355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.723709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.723973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.724242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.735896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:19.736778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.737066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.737348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.738661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.740202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12779e09-c646-4e94-9ec4-a8f4eb19868a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.742277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 176/359] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:19.743608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.744469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.744754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:19.765641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:19.768069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:19.839034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:19.840538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a53eb6-84fc-4ec1-9927-b2268445e5f2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:19.874606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 177/360] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:19.874818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:19.875517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:19.975935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 184/361] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:19.983458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:19.983749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:19.984011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.002547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:20.003761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:20.017736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133e17-1444-4644-921d-6a0749b5d06d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.053053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.062858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.068753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.068753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.068753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.102971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 185/362] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:20.111067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.180074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.181568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.195670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.259320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f966b7-1878-443d-9205-5ab2e0850866 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.307108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.308058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.308343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.308620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.309488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=3ec648ba8e024846bac298ee23998c07) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:20.309803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.314076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.321199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 186/363] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:20.325927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.335304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 178/364] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:20.337051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.377768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.503901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f8f0d-493b-4724-9817-1cd5edb97e5c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.513291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2426-1601-4497-898f-66ebcc097898 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.532214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.557265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.558614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.558886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.559427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.560007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.560187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.560438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.560720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.562393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.564247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.566891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 179/365] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:20.568172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.579519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:20.589089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:20.590089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 20:43:20.590870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:20.591482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 187/366] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:20.592102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.705780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.717337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230a1f-bae6-40c7-8563-5420958ab98e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.735255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b300b-e04e-4054-8bd9-ad9fbf6c15c1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.787386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.787386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.787386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.787386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.794172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:20.794362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:20.794362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:20.794362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:20.794362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:20.794792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:20.794792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 188/367] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:20.794792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.816263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:20.827217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:20.828182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:20.828963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:20.831648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 180/368] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:20.832807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:20.882964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:20.973788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f278d1-2563-433d-8a28-e48a0f76a25a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:20.987245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4edef-2ee1-4be4-83f6-9c46f8f92838 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.026807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.028454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.029137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.029556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.031058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.033282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.035858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 189/369] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.036712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.037006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.037666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.038082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.038456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.040973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.041501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.043269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.053655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 181/370] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.054836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.093177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.171646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518b6a-ba21-410a-98a6-2696efb08c72 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.184681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451d6a-3515-4e02-85c1-8c008d97d77a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.187688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.209850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.211169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.211858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.212380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.213958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.215665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.218180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 190/371] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.219344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.222919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.223608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.223888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.224162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.224924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.225228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.226645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.241070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 182/372] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.241070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.326168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.342303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425872-1c8c-4832-a76a-41b51cc96c9d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.349680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d152-a854-4775-98a0-d98ad250f660 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.384449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.385621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.386146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.386738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.387133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.388075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.388595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=ba84795116f349709142360a12649701, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.389121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.389641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.389961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] PATH_INFO: `/v3/users/0bfe4e0556674ef0a832fd101f3f603c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.391222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] RBAC: Authorizing `identity:get_user(user_id=0bfe4e0556674ef0a832fd101f3f603c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.391489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.392671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.394681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 183/373] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/users/0bfe4e0556674ef0a832fd101f3f603c => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.395476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.399355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 191/374] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=ba84795116f349709142360a12649701 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.401239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.455093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.514428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf7b-8ec5-41ee-9285-9df96fe40325 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.525266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910967-bb62-4cc6-ad9e-2047309839d0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.554223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.554593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.554855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.555130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.556078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=ba84795116f349709142360a12649701, scope.project.id=3ec648ba8e024846bac298ee23998c07) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.556393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.557962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.564539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 184/375] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=ba84795116f349709142360a12649701 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.565403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.572833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.573974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.574475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.574960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.582035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.682942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.684904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.689637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3262c5-9c32-484b-aabe-e947759ea7b2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:21.732939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:21.733552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:21.733832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:21.734139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:21.734991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] RBAC: Adding query filter params (role.id=464de7ac8e1e447ab1e5c98a963b867e, user.id=0bfe4e0556674ef0a832fd101f3f603c, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:21.735311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:21.736838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:21.748137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.751166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 185/376] 10.222.0.55 () {56 vars in 1308 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/role_assignments?user.id=0bfe4e0556674ef0a832fd101f3f603c&scope.system=all&role.id=464de7ac8e1e447ab1e5c98a963b867e => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:21.834186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:21.845104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 192/377] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:21.930880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:21.972902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e1bd6-9695-4b27-8100-4fc84f6460e7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.019939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.020934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.021214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.021535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] PATH_INFO: `/v3/projects/f6a1a8d766964543bcc4e46371605ff7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.022989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a1a8d766964543bcc4e46371605ff7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:22.024525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbadf0f-91e5-4e06-a2d8-9ffa4ff03a13 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:22.027369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 186/378] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:21 2022] GET /identity/v3/projects/f6a1a8d766964543bcc4e46371605ff7 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:22.033266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:22.154868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b204c34-c535-43ad-9525-fe64c2417238 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.173294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3666-64f5-402e-a563-2697fa746e4e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.173614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3666-64f5-402e-a563-2697fa746e4e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.173866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3666-64f5-402e-a563-2697fa746e4e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.175652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 187/379] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:22.182567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.183025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.183314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.199729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.200619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.200900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.201176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] PATH_INFO: `/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.207904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] RBAC: Authorizing `identity:get_group(group_id=0db53663d38f4ee8abe9ba1a5e1a309f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:22.208965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:22.209398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:22.210295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:22.211799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 193/380] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:22 2022] GET /identity/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:22.219544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:22.242425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:22.353722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 188/381] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:22.409039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c04af7-849e-4490-a391-4affe1c3b934 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.422872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:22.465350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.466045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.466336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.466611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.467791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] RBAC: Adding query filter params (group.id=0db53663d38f4ee8abe9ba1a5e1a309f, role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=f6a1a8d766964543bcc4e46371605ff7) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:22.468108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:22.469759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:22.476773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 194/382] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:22 2022] GET /identity/v3/role_assignments?group.id=0db53663d38f4ee8abe9ba1a5e1a309f&scope.project.id=f6a1a8d766964543bcc4e46371605ff7&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:22.546103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:22.595684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94167-c7a1-4f69-886c-82cf080b2d98 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.650966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.651823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.652109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.652386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.669543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:22.678348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:22.679309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:22.680103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 189/383] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:22.686552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:22.802326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:22.833300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d5c6-0d3e-4d73-89c9-9f43fea5c935 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:22.874397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:22.875088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:22.875375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:22.875650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:22.876438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:22.876751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:22.878167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:22.894012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 195/384] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:22.895794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:23.033006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213858b8-c8ee-4c95-a7c8-bc5d9b59c682 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:23.067916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:23.076892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:23.079308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.079308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.079308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.079590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:23.081070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:23.082898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 190/385] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:22 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:23.088909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:23.232722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a930-bf77-4099-b6ca-c1910c0baf43 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:23.279270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:23.280154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.280440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.280715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.286710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:23.288217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc20702-19c4-4cfe-8659-c638db740a93 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:23.291062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 196/386] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:23 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:23.297100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:23.444390 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29d5d9-eee3-4e54-8573-d097375c2e5e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:23.497845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:23.498780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.499068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.499347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/groups/873948f9a5ba4115b28b41a97c976913/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.501857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, group_id=873948f9a5ba4115b28b41a97c976913, role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:23.503353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed993ad-8c27-415c-8acc-7878d38b5bf9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:23.595667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 191/387] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 31 20:43:23 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/groups/873948f9a5ba4115b28b41a97c976913/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:23.657726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb689b-5eaa-4d69-b22b-3857a3da6915 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.658087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb689b-5eaa-4d69-b22b-3857a3da6915 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.658327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb689b-5eaa-4d69-b22b-3857a3da6915 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.659997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 197/388] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:23.666238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.666844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.667326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.691323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:23.692915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:23.769010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:23.800372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 192/389] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:23.824478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb689b-5eaa-4d69-b22b-3857a3da6915 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:23.828888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:23.937560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb689b-5eaa-4d69-b22b-3857a3da6915 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:23.976556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:23.977387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:23.977671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:23.978032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:23.995999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:24.004690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:24.005559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:24.006845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 198/390] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:24.012749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.152910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603f8f3-886d-4c37-b021-9dac19de60f1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.201738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.202479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.202767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.203039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.203863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:24.204179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.205676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.220391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 193/391] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:24.226199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.331060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:24.382070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d4a8c-23dc-4520-b375-73e737742f5f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.427726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.428523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.428807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.429085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.430522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.432505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.434499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 199/392] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:24.440584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.498467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:24.565320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f9c3a-ef14-4e88-8b22-aec03d9ada95 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.634909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.636447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.636944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.637439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.639600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.641614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3b137-eaf2-44e0-9c24-104f9185fc04 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.643819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 194/393] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:24 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:24.649153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:24.735758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b617e-98b9-429b-9143-9c06e8b5e265 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.736797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b617e-98b9-429b-9143-9c06e8b5e265 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.737251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b617e-98b9-429b-9143-9c06e8b5e265 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.739454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 195/394] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:24.755461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ef64-c187-4896-8f6f-b21a3dd88247 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.755748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ef64-c187-4896-8f6f-b21a3dd88247 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.756032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ef64-c187-4896-8f6f-b21a3dd88247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.780873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-43d0ef64-c187-4896-8f6f-b21a3dd88247 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:24.782110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43d0ef64-c187-4896-8f6f-b21a3dd88247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:24.845479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63648-1d48-4584-9df0-e306f4f238e8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:24.884211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:24.885298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.885585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.885863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/groups/873948f9a5ba4115b28b41a97c976913/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.888255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, group_id=873948f9a5ba4115b28b41a97c976913, role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:24.889718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:24.894302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:24.914924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 196/395] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:24.919073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ad78-e943-462f-9ac5-bafffca10bd8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.919379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ad78-e943-462f-9ac5-bafffca10bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.919820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ad78-e943-462f-9ac5-bafffca10bd8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.925826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 197/396] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:24.927450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:24.927750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:24.928034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:24.946824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:24.948118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:25.000757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:25.029325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 200/397] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 31 20:43:24 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/groups/873948f9a5ba4115b28b41a97c976913/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:25.034920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 198/398] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:25.035455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.057238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.277331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f6fc8-c6b4-4c99-88f5-981d99e74d2e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.298705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac7157-b460-4297-bc46-da5aa16c4757 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.358355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.359154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.359440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.359717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.364888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.366152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.366653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.367344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.375505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:25.382280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:25.385337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:25.386250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:25.387037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:25.393951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 201/399] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:25.397758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:25.398796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:25.401734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 199/400] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:25.403805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.409513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.451185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:25.469040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:25.527501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97584-87b8-45f7-b131-bf68312fc46e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.554199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efd8-494a-4c46-ac27-2c82738a0a67 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.572317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.573681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.574178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.574877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.575818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:25.576467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:25.578428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8d47-2ecf-4fca-8bbb-315ec6b78fe4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:25.595729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 202/401] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:25.595729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a23-7c6b-4927-a3a0-22fa9fb5a876 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.595729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a23-7c6b-4927-a3a0-22fa9fb5a876 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.596046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a23-7c6b-4927-a3a0-22fa9fb5a876 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.597403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 203/402] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:25.598852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e6a23-7c6b-4927-a3a0-22fa9fb5a876 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.607174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.607863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.608149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.608460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.609238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:25.609547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:25.610987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f68ce-e8ee-412a-b094-9aa5bbb9df66 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:25.622801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 200/403] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:25.624456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.624755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.625037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.646450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:25.647727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:25.733425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 201/404] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:25.739238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.750132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e6a23-7c6b-4927-a3a0-22fa9fb5a876 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.771922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:25.783773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:25.806043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.807248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.807797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.808446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.809926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:25.811686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:25.813507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 204/405] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:25.814476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.891834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54402c-d08b-46ec-a45a-94dd0d4b01fa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.934349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.935380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.935765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.936141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:25.937796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:25.939340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:25.940837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658160f-e503-4da2-a59f-ba19ff9aa60e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:25.941288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 202/406] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:25.942113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:25.985873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:25.986986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:25.987422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:25.987840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.000431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:26.009520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:26.010499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:26.011338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:26.014066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 205/407] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:26.015235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.065863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.074281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3fb50-7b1c-48cd-996d-d0e0cb9e989e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.084616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.109043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.109980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.110522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.110522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.112005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.113471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.121818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 203/408] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:25 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:26.122300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.168455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665193-a441-4e0d-a179-d263206b4285 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.216010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.218005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.218507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.219231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.221036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.222732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.226007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 206/409] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:26 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:26.227459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.240532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e009d-47c9-4ecf-ac95-7ea071b995b2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.287093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.288202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.288660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.289435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.291166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:26.291625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.293986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.306397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 204/410] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:26.307431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.341399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.354929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cb06-85a3-4240-b85b-05b903786ddb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.370372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.398873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.399845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.400130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.400409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/groups/873948f9a5ba4115b28b41a97c976913/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.402473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d4e8b473d4746f4ba53769be39ac5d2, group_id=873948f9a5ba4115b28b41a97c976913, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.403987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.428368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942859f-5da1-4d36-9a25-c4a7c00cf167 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.464353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.465240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.465527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.465798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07/groups/873948f9a5ba4115b28b41a97c976913/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.467855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] RBAC: Authorizing `identity:create_grant(project_id=3ec648ba8e024846bac298ee23998c07, group_id=873948f9a5ba4115b28b41a97c976913, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.469297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a2fb-a837-46f5-a2a2-b404e13fda4c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.527554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 207/411] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 31 20:43:26 2022] PUT /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2/groups/873948f9a5ba4115b28b41a97c976913/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:26.528174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.571188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 205/412] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 31 20:43:26 2022] PUT /identity/v3/projects/3ec648ba8e024846bac298ee23998c07/groups/873948f9a5ba4115b28b41a97c976913/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:26.573231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7539-a2ee-4f46-ba52-2f079c29f142 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.573523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7539-a2ee-4f46-ba52-2f079c29f142 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.573803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7539-a2ee-4f46-ba52-2f079c29f142 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.575305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 206/413] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:26.581378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.581722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.581972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.600936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:26.602292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:26.677178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fd5b3-86cf-4080-b75f-6b484e6d16d7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.723555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.724638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.725072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.726659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] PATH_INFO: `/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.728248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] RBAC: Authorizing `identity:get_group(group_id=0db53663d38f4ee8abe9ba1a5e1a309f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.729925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.731903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 208/414] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:26 2022] GET /identity/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:26.739424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.789918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 207/415] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:26.810183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.812878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.833818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:26.889455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601fde7-5d0e-4767-93ff-e2d0419302b2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.951839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740daa7b-285e-4650-bbad-c93e124c94b7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:26.954531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.956012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.956516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.957040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] PATH_INFO: `/v3/projects/f6a1a8d766964543bcc4e46371605ff7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:26.962739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a1a8d766964543bcc4e46371605ff7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:26.964531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:26.970966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 209/416] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:26 2022] GET /identity/v3/projects/f6a1a8d766964543bcc4e46371605ff7 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:26.972164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:26.988624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:26.989490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:26.989821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:26.990134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.002638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:27.013025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:27.013990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:27.014800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:27.018023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 208/417] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:27.022949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:27.174408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.200890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9120c1-390a-4702-a00c-a06811619cf6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:27.203950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51194b-c844-4f3d-bb3f-0350b97133da None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:27.211692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.246626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:27.247635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.248094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.249542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.250595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:27.251136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:27.252842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:27.263044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 209/418] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:27.268913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:27.283219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:27.284158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.284420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.284705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] PATH_INFO: `/v3/projects/f6a1a8d766964543bcc4e46371605ff7/groups/0db53663d38f4ee8abe9ba1a5e1a309f/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.286815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1a8d766964543bcc4e46371605ff7, group_id=0db53663d38f4ee8abe9ba1a5e1a309f, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:27.288274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:27.387974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8296e-efe3-42e9-bd10-93bc1fde3a21 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:27.389441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 210/419] 10.222.0.55 () {58 vars in 1442 bytes} [Tue May 31 20:43:26 2022] PUT /identity/v3/projects/f6a1a8d766964543bcc4e46371605ff7/groups/0db53663d38f4ee8abe9ba1a5e1a309f/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:27.436444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:27.437121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.437403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.437719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.442312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.516924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:27.518437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06bf82-a584-4e8b-b5eb-6f12c74414c7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:27.629365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 210/420] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:43:27.635050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:27.757867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dff54-167d-4122-85e1-dff897d923d8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.758093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dff54-167d-4122-85e1-dff897d923d8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.758362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dff54-167d-4122-85e1-dff897d923d8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.759972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 211/421] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:27.766321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.766649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.766876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.767173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9800-e438-45bc-8958-211191cb1c01 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:27.802708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:27.804257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:27.825458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:27.827174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:27.827665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:27.828244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:27.829689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:27.833714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:27.836157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 211/422] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:27 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:27.842311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:27.862282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.889317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 212/423] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:27.913528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:27.918926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:28.043114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5296f-2930-4f99-8860-5d404ec3ea2c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:28.067956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c42d72-ecf4-45f2-b2e7-e1d6c3206693 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:28.086466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:28.088325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:28.088614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:28.088894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:28.115524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:28.126824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:28.127792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:28.128595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:28.139869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 213/424] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:28.144245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:28.145591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:28.147253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:28.148903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:28.151402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:28.153959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:28.155838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:28.161666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 212/425] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:27 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:28.172829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:28.208571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:28.380407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80510f-8c7d-4a39-ba7d-21f69d45bfb5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:28.385174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:28.402914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272c436-0e95-4000-8673-071a5debf7dc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:28.458125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502487d-2784-466d-af10-24909a465990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:28.459277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502487d-2784-466d-af10-24909a465990 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:28.460504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502487d-2784-466d-af10-24909a465990 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:28.461611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502487d-2784-466d-af10-24909a465990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:28.462860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502487d-2784-466d-af10-24909a465990 None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:28.464501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502487d-2784-466d-af10-24909a465990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:28.466736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502487d-2784-466d-af10-24909a465990 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:28.474032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 213/426] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:28 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 611 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:28.487501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:28.488210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:28.488498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:28.488780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:28.489579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:28.489934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:28.491366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:28.512853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 214/427] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:28.518120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502487d-2784-466d-af10-24909a465990 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:28.658658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502487d-2784-466d-af10-24909a465990 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:28.705306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:28.706432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:28.706929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:28.707474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:28.765056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:28.814076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:28.815571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:28.937870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 214/428] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:28.943076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.045696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.057906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fda5c0-3e55-4019-83c8-01d31c6f68df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.101439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.102421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.103218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.103498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.105040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:29.106604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420b796-ec10-48cc-9be5-d75b26c5223e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:29.108831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 215/429] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:28 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:29.114566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.185635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.222065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0b7f-446c-4668-8678-afead6d524ed None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.234591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9181-28e9-415e-997f-b5e0256e3a26 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.234906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9181-28e9-415e-997f-b5e0256e3a26 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.235153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf9181-28e9-415e-997f-b5e0256e3a26 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.236804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 216/430] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:29.243768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11507-94c9-4646-baaf-002e18404501 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.244054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11507-94c9-4646-baaf-002e18404501 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.244334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11507-94c9-4646-baaf-002e18404501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.265879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cef11507-94c9-4646-baaf-002e18404501 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:29.267202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cef11507-94c9-4646-baaf-002e18404501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:29.269242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.270357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.270844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.271337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.272688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:29.274381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:29.276495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 215/431] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:29.283100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.353702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 217/432] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:29.377983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef11507-94c9-4646-baaf-002e18404501 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.402679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473be4ad-7f66-420d-a12e-807fc76727ba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.441117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.441784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.442085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.442359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.443364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=3ec648ba8e024846bac298ee23998c07) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:29.443679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:29.445252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd48f8-bb08-4557-96bc-308efd7a6cd7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:29.447405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.453178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 216/433] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:29.492744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b665b-a946-4d35-b6de-7af0c712f49a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.492949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b665b-a946-4d35-b6de-7af0c712f49a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.493809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b665b-a946-4d35-b6de-7af0c712f49a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.495587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 217/434] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:29.498641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.502600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.502888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.503154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.517437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef11507-94c9-4646-baaf-002e18404501 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.521120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:29.522478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:29.560396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.561924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.562485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.562965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.577047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:29.587093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:29.588072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:29.588851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:29.590251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 218/435] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:29.595192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.618631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 218/436] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:29.635911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.714573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352da2a-b9d4-4899-848a-fc4deff6c864 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.757638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.757823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392568-0d35-45b3-8c92-5eb48b085855 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.757935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.757935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.757935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.757935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:29.758184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:29.759645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:29.769975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 219/437] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:29.776913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.796895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.798737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:29.808121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.808929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.809207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.809541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.821646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:29.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:29.830920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:29.831717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 219/438] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:29.837651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:29.896414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fb4d-13ef-4f69-a630-1a873dae508e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.932282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.932937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.933218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.933492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.954145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5db34-d86b-4fe1-8e6f-5a72baa7fa29 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:29.993478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:29.994223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:29.994504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:29.994774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:29.995558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:29.995923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:29.997610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.010012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 220/439] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:30.014289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.016228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.017718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb040550-f4e5-409c-aaec-e3b520c1c188 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.029748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.068957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.123691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6a83f-e073-4610-b564-bae80a0675e6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.124832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 220/440] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:30.126382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa44e8-b018-4016-99df-04ba2db42ed1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.126674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa44e8-b018-4016-99df-04ba2db42ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.126959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa44e8-b018-4016-99df-04ba2db42ed1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.128233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 221/441] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:30.130219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa44e8-b018-4016-99df-04ba2db42ed1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.161322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.162009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.162299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.162667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.234540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa44e8-b018-4016-99df-04ba2db42ed1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.234814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.236350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c3c85-7858-4721-8c7a-22a8489e0cfa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.290476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.350409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 221/442] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 20:43:30.351755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.352043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.352331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.365976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.370521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:30.371983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:30.396167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.397308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.398201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.398201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] PATH_INFO: `/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.399967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=4d4e8b473d4746f4ba53769be39ac5d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.401462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.403218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 222/443] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/projects/4d4e8b473d4746f4ba53769be39ac5d2 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:30.403986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.443538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 222/444] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:30.444402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.515979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a255ff-539e-4e65-844b-d753bbd89ea6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.534490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.553465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027976a-8ece-4f73-bb61-3a51ded01372 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.557623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.559167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.559670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.560184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] PATH_INFO: `/v3/projects/3ec648ba8e024846bac298ee23998c07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.562160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] RBAC: Authorizing `identity:get_project(project_id=3ec648ba8e024846bac298ee23998c07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.564899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.572974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 223/445] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/projects/3ec648ba8e024846bac298ee23998c07 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:30.572974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.594148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.595030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.595318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.595601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.596870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.598408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.600119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 223/446] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:30.600980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.635569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.707721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f65b-67a4-4514-8b34-e314db9953a2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.720670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db1e2-7a63-4a8f-a1de-af6a38f6748b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.742785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.744211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.744495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.744767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] PATH_INFO: `/v3/groups/873948f9a5ba4115b28b41a97c976913` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.746274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] RBAC: Authorizing `identity:get_group(group_id=873948f9a5ba4115b28b41a97c976913)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.747761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.749645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 224/447] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/groups/873948f9a5ba4115b28b41a97c976913 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:30.750243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.769325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.771858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.773240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.773677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.774191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.786279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:30.794650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:30.796514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 224/448] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:30.799475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.866318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0c4f1-e05e-4641-a194-a0b8b856a0fe None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.904071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.904807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.904988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.905262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.906124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=ba84795116f349709142360a12649701, scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:30.906433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.907862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.910754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa379f8-fa51-47c8-b25e-439a16610a43 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:30.913193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:30.914545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 225/449] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=4d4e8b473d4746f4ba53769be39ac5d2&role.id=ba84795116f349709142360a12649701 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:30.915904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:30.951664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:30.952887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:30.953187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:30.953588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:30.954398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] RBAC: Adding query filter params (group.id=873948f9a5ba4115b28b41a97c976913, role.id=ba84795116f349709142360a12649701, scope.project.id=3ec648ba8e024846bac298ee23998c07) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:30.954712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:30.956229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:30.963388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 225/450] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/role_assignments?group.id=873948f9a5ba4115b28b41a97c976913&scope.project.id=3ec648ba8e024846bac298ee23998c07&role.id=ba84795116f349709142360a12649701 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:31.025090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:31.050895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afca01d-2a1f-4372-9a27-f2bb281bd45c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.095181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.095975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.096260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.096535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.097327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:31.097638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.099134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.110412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 226/451] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:31.116099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:31.242216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee59cd-a018-490b-8b80-480aa3866d57 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.292838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.293804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.294274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.294713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.341669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:31.380492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.382058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.499482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 226/452] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:31.505268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:31.611661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24160fda-80f7-45f5-a484-716e3484c9c0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.646904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.647773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.648056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.648332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] PATH_INFO: `/v3/projects/f6a1a8d766964543bcc4e46371605ff7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.650124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] RBAC: Authorizing `identity:get_project(project_id=f6a1a8d766964543bcc4e46371605ff7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.651550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.653262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 227/453] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:43:31 2022] GET /identity/v3/projects/f6a1a8d766964543bcc4e46371605ff7 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:31.658899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:31.727954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:31.766021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a0ef-3249-431a-87ad-9556071da53d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.799429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.800299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.800590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.800867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] PATH_INFO: `/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.802093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] RBAC: Authorizing `identity:get_group(group_id=0db53663d38f4ee8abe9ba1a5e1a309f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.803595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11903f6e-a497-4de2-9809-5f4a67f15e68 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.806129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 227/454] 10.222.0.55 () {56 vars in 1180 bytes} [Tue May 31 20:43:31 2022] GET /identity/v3/groups/0db53663d38f4ee8abe9ba1a5e1a309f => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:31.811894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:31.825249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:31.912647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e55ad-5a22-40ef-ba17-59e4a616449d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:31.945496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:31.946334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:31.946617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:31.946892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:31.947727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] RBAC: Adding query filter params (group.id=0db53663d38f4ee8abe9ba1a5e1a309f, role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=f6a1a8d766964543bcc4e46371605ff7) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:31.948036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:31.949461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68349-7932-4fc7-aeaf-94edf0130ff8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:31.955361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 228/455] 10.222.0.55 () {56 vars in 1376 bytes} [Tue May 31 20:43:31 2022] GET /identity/v3/role_assignments?group.id=0db53663d38f4ee8abe9ba1a5e1a309f&scope.project.id=f6a1a8d766964543bcc4e46371605ff7&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:34.591076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ee6-20e3-4e5e-94f4-52f825905767 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.592102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ee6-20e3-4e5e-94f4-52f825905767 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.592595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ee6-20e3-4e5e-94f4-52f825905767 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.594491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 228/456] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:34.599682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc594-c6e6-435e-b879-e45fb1424cd8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.600551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc594-c6e6-435e-b879-e45fb1424cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.601032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdc594-c6e6-435e-b879-e45fb1424cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.631042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6acdc594-c6e6-435e-b879-e45fb1424cd8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:34.632622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6acdc594-c6e6-435e-b879-e45fb1424cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:34.720574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 229/457] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:34.757167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2542ee6-20e3-4e5e-94f4-52f825905767 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:34.915676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2542ee6-20e3-4e5e-94f4-52f825905767 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:34.928483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bcb-a887-4ba4-b9f8-d452f2e414d6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.929123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bcb-a887-4ba4-b9f8-d452f2e414d6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.929602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1bcb-a887-4ba4-b9f8-d452f2e414d6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.931979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 230/458] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:34.939191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae763e-4247-40df-aa58-60cb7484ef2f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.939722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae763e-4247-40df-aa58-60cb7484ef2f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.940210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae763e-4247-40df-aa58-60cb7484ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.957520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:34.958359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:34.958808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:34.959089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:34.969966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:34.978510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:34.979996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:35.011756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:35.012681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:35.013500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:35.013500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:35.013500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.013500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:35.022483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 229/459] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:35.031944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.094085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.104278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-18ae763e-4247-40df-aa58-60cb7484ef2f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:35.106413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-18ae763e-4247-40df-aa58-60cb7484ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:35.203114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c41bfa-152b-4114-b426-bbde23d7cca0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.238248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 231/460] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:35.239860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047894-3a30-432f-92f5-59a217708051 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.240316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047894-3a30-432f-92f5-59a217708051 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.240733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047894-3a30-432f-92f5-59a217708051 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.242167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 232/461] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:35.245367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.246478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.246916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.247329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.248197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:35.248656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.250222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.258837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.259310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.259729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.278448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 230/462] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:35.278802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:35.279548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.280454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:35.336554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.359179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 233/463] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:35.360384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.415249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41998838-e547-40f5-83bb-78572e65b608 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.429314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.451557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.452441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.452735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.453034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.464131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.465540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.469372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30a1b-0589-48b5-9476-94d1e0cee711 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c0fb1f70-cd28-4672-80e9-13dada3a4a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:35.484666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:35.485525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:35.486768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:35.486768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:35.486768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.486768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:35.486768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 231/464] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:35.487111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff785b-5356-47cb-a39d-e274764d774d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.487484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff785b-5356-47cb-a39d-e274764d774d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.487645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff785b-5356-47cb-a39d-e274764d774d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.489051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 232/465] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:35.494315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff785b-5356-47cb-a39d-e274764d774d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.509568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.510423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.510693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.510969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.511672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.513094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.592676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.596438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff785b-5356-47cb-a39d-e274764d774d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.617271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 234/466] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:35 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:35.619337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.636112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.637301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.638295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.638755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.652283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.654247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-97d06f61-b068-47a7-8161-bc7c539b9d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:35.675103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:35.676030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:35.676852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:35.676852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:35.676852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:35.676852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:35.679043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 233/467] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:35.685531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.686075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.686526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.711034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:35.713936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:35.746790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9438e8-5e3d-405d-b35d-f8f3a5b333a3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.769121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.796962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.797775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.798245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.798623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.805932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:35.805932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.805932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:35.806688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 234/468] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:35.807889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.826120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 235/469] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:35.828732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:35.912866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:35.939276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f205181-ebe4-46c3-a9be-8fd6d104f132 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.960607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce8508-16a9-4580-bfd6-a1b4a97962dc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:35.980357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:35.981377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:35.981715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:35.982020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:35.983032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:35.983736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:35.985140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.003435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.004048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.004333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.004617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.005391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.005566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 235/470] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:36.006462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:36.007357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.100593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 236/471] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:35 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:43:36.101558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:36.124862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8616-325e-4568-a602-00667f804dc1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:36.170422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.171300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.171591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.171874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.185879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.187402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.189438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:36.191048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:36.210286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:36.211287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:36.212652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:36.212652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:36.212652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:36.212652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:36.212652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 236/472] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:36.220104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:36.335782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f708f-bb43-46c8-ab67-5ddfd30102fe None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:36.352800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d32b-11a4-4a9a-994e-9fac9234568d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:36.397029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.397751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.398111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.398394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.399721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.399869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:36.400109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.400555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.400910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.401257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.401494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e83c1-ee33-4551-9062-a7bda751f807 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.402832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.405214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801cd55-0715-4551-abfe-a21bb8251935 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.416360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 237/473] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:36.418181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6e1a-78ae-45cc-8e88-8c3890b11e7e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.418475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6e1a-78ae-45cc-8e88-8c3890b11e7e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.418754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6e1a-78ae-45cc-8e88-8c3890b11e7e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.420224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 238/474] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:36.424782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd6e1a-78ae-45cc-8e88-8c3890b11e7e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:36.485425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:36.526999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 237/475] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:36 2022] POST /identity/v3/users => generated 249 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:36.528643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.529098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.529516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.557461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd6e1a-78ae-45cc-8e88-8c3890b11e7e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:36.561023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:36.561637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:36.625795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.626418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.626704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.626980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.630760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.633241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.679406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 238/476] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:36.703545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:36.733762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:36.753192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 239/477] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:36 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:36.837812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dc7fe-b459-40eb-8f84-37099c3aa3b0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:36.883764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:36.884391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:36.884670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:36.884941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:36.885729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:36.887154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:36.946905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.sql.core [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:43:36.946905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 20:43:36.946905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [parameters: {'id': '6c8118ea46274a1986cd229a948afcfd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 20:43:36.946905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() May 31 20:43:36.964689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return ref.to_dict() May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:43:36.965669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application yield resource May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise self.value May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application session.commit() May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:43:36.966573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.flush() May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application compat.raise_( May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:43:36.967423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:43:36.968271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:43:36.969069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [parameters: {'id': '6c8118ea46274a1986cd229a948afcfd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:36.969823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 20:43:36.972759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:36.974835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 239/478] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 31 20:43:36 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:36.974980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:37.093600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf959a-3026-4510-8eb8-b4bfeaedf354 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:37.111526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:37.129146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:37.129997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:37.130285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:37.130565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:37.142667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-12f5f3ea-4326-473a-a85b-cb4e9ddd9453 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:37.152594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:37.153527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:37.154781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 240/479] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:37.160048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:37.252112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:37.267604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacef55-c230-4c9e-94c0-736aafd41ae3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:37.303576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:37.304268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:37.304583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:37.305467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:37.306311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:37.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:37.307989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce48510-6353-430d-a2c5-5d862f869bff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:37.316784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 240/480] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:38.216303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a578-8f8b-4536-ba49-02ef997f21c4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:38.217342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a578-8f8b-4536-ba49-02ef997f21c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:38.217834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52a578-8f8b-4536-ba49-02ef997f21c4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:38.219852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 241/481] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:38.225487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:38.226330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:38.226853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:38.249582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:38.251195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:38.322713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 241/482] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:38.346592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52a578-8f8b-4536-ba49-02ef997f21c4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:38.483961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52a578-8f8b-4536-ba49-02ef997f21c4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:38.519500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:38.520309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:38.520591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:38.520868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:38.533333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:38.541794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:38.542748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:38.543611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 242/483] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:38.550575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:38.693501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:38.720631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebcf82-0fcb-4311-bdb3-7542675df614 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:38.770947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:38.771986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:38.772476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:38.772977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:38.773994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:38.774521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:38.776176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f007ed-f70f-4f1b-8a07-fa9acfff9c30 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:38.789595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 242/484] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:38.796109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:38.857108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:38.999597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a983-49bb-4a48-a771-e7cd01c8628f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:38.999927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a983-49bb-4a48-a771-e7cd01c8628f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.000474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a983-49bb-4a48-a771-e7cd01c8628f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.002381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 243/485] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:43:39.008839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.009302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.009770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.021403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0908a4-4d8d-43fd-a800-44b3a6aeac3e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.059011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:39.060225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:39.061053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.062117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.062659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.063246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.074550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:39.076281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:39.096861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:39.097784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:39.098654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:39.098654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:39.098654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:39.098654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:39.100905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 243/486] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:39.109098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.192509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 244/487] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:39.239957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:39.260948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f8786-828b-45bc-a02b-dad349ab5d36 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.271000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.299638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.300535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.300945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.301348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.302294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:39.302727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:39.304227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:39.317858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 244/488] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:39.326085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.449264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:39.558467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ed41-2933-4e0e-8141-fc8040739034 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.619382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242677-8647-4261-8a56-f46330f55b62 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.651855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.653332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.653826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.654343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.694559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:39.702437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:39.703304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:39.704073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 245/489] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:39.710837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.714039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.714913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.715262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.715609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.723921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:39.725466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:39.748780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:39.749724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:39.750634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 245/490] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:39.755686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.768163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:39.882288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4efd1-a8bf-4cc8-b637-b90424b0630e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.888029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d29f3-ef5e-4226-9997-76d97eae2fd1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:39.920015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:39.923423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.924107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.924393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.924671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.925521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:39.925704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:39.925819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:39.926403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.926682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.927000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.927304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5e6ed-ede9-499e-8fd4-f940a63c8c16 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:39.927782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:39.928084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:39.929558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c9d4-5e7e-4084-9229-33729fa42782 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:39.942239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 246/491] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:39.943979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d11-8e90-4d7f-9148-4b98275bca9d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.944270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d11-8e90-4d7f-9148-4b98275bca9d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.944546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9d11-8e90-4d7f-9148-4b98275bca9d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.946708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 247/492] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:39.947786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8b3-9a93-46f2-9d5d-fa5951d73877 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.948068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8b3-9a93-46f2-9d5d-fa5951d73877 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.948398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa8b3-9a93-46f2-9d5d-fa5951d73877 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.949734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 248/493] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:39.954302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa8b3-9a93-46f2-9d5d-fa5951d73877 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:39.975381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 246/494] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:39.975381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffd5-5569-449d-9221-3ad58c76e56d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:39.975381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffd5-5569-449d-9221-3ad58c76e56d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:39.975381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ffd5-5569-449d-9221-3ad58c76e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:39.991383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-58f1ffd5-5569-449d-9221-3ad58c76e56d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:39.992670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-58f1ffd5-5569-449d-9221-3ad58c76e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:40.052613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.063481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 247/495] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:40.064857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.065121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.065397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.075038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa8b3-9a93-46f2-9d5d-fa5951d73877 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.083189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:40.084582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:40.118200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.119252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.119584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.119862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.131193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.133493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:40.153181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:40.154143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:40.154957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:40.154957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:40.154957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:40.154957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:40.155172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 248/496] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:40.155693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.166616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 249/497] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:40.166616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.215410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.278442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f54d86-7634-4b05-8838-9026637c93e3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.279096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6bbe3-fbad-4e45-a5d8-140548b555c2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.300558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.316470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.317117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.317398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.317663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.323274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.324121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.324445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.324731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.336607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:40.344545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:40.345499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 250/498] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:40.346940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.396459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.397827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.457545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caf7e3-b46d-4fe1-9aa3-dd46ec9ad93f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.460722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.493988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.494660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.494942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.495246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.496257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:40.496563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.497940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.506481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 249/499] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:40.507378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.509945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 251/500] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:40.512556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.529744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.606284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5588a6-7ebf-407a-a632-272b5223a7f4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.609222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5853-5203-41a0-b38d-9ac4da09eee6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.640193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.640999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.641277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.641550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.643324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.643991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.644278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.644554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.645315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:40.645627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.647088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d690574-c3c4-45cd-b210-2c086e24d67c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.652223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:40.655185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 252/501] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:40.656461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e04-5f98-487a-8b74-994bc602b6d6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.656750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e04-5f98-487a-8b74-994bc602b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.657031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e04-5f98-487a-8b74-994bc602b6d6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.658450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 253/502] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:40.658999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347e04-5f98-487a-8b74-994bc602b6d6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:40.661334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:40.662297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:40.663103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 250/503] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:40.663758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.690649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.746135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.764233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821761-032c-47db-8bf1-54cfded23ff8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.764532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347e04-5f98-487a-8b74-994bc602b6d6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.798165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.798304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.798974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.799067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.799252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.799338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.799523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.799618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.807265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.808726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.811106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.812678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:40.824567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:40.825491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:40.826404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 254/504] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:40.826942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a995511e-0e31-4a43-959b-1b1a9fdedef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:40.830930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:40.831859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:40.832734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:40.832734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:40.832734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:40.832734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:40.832734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 251/505] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:40.833298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.833584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.833845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.849810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:40.851025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:40.920060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 252/506] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:40.921125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:40.924894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:40.940054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f73f-6039-4ae5-b45d-f04b90405b37 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:40.974231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:40.975038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:40.975324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:40.975598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:40.986358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:40.987836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:40.993330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:41.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:41.007764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 255/507] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:41.009327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.034230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc4c9-20cf-46f3-a8ba-b5d98693388b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.067784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.068451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.068738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.069016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.069767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.070099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.072022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.080509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 253/508] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.081314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.109109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30fa8f-db15-4037-94fe-bbb421f97193 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.143331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.143991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.144273 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.144554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.145405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.145707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.147164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.165987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.184620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13401518-1110-42da-8c5d-60aac0070638 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.185729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 256/509] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.186596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.206501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.217745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.218442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.218722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.219049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.224677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.224677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.224677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.232607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 254/510] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.233391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.285635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60813-626d-4d21-8eb5-d7133e1786ea None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.320558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.321351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.321630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.321919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.331635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e553-90ee-4ca8-80a4-bdef7205490e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.335496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.337052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:41.355317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:41.356202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:41.357014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:41.357014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:41.357014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.357014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:41.357014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 257/511] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:41.357558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.371510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.372180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.372462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.372732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.373448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.373751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.375154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.386804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 255/512] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.387671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.408459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.433748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.459463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e71014-8b43-4353-82a8-bc9544f0bac8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.485713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609a9e-b8e4-469a-a081-0b91d578cdd5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.493793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.494617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.494901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.495176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.505933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.507393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.520218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.520862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.521147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.521426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:41.524509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:41.525300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:41.526189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:41.526189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:41.526189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:41.526189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:41.526189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 258/513] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:41.527330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.592088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.593584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.628540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.631426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ce3af-0dac-407d-8384-ba1c016ea1ca None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.637400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.664836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.665632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.665923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.666303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.673103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.674596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:41.689506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:41.690551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:41.691824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:41.694924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 256/514] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:41.695459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.695573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 259/515] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:41.696375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.793472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc828f78-8d0a-4ebf-830f-73c086257056 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.794948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36039-a0fe-41ea-bb29-b6e4cf54a4f4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.829209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.829878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.830234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.830513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.831240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.831555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae83078-1006-40df-bf80-46045003db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.831667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.832346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83078-1006-40df-bf80-46045003db14 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.832625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83078-1006-40df-bf80-46045003db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.832896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83078-1006-40df-bf80-46045003db14 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.832995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.840516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae83078-1006-40df-bf80-46045003db14 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.842055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae83078-1006-40df-bf80-46045003db14 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.844591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 257/516] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.845401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.849011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fae83078-1006-40df-bf80-46045003db14 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:41.861975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:41.862927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:41.863860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 260/517] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:41.864535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae83078-1006-40df-bf80-46045003db14 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:41.888569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:41.946354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06f3a-2790-4df8-aff9-ff7543a81ab5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.965302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae83078-1006-40df-bf80-46045003db14 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:41.979716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:41.980380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:41.980666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:41.980947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:41.981666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:41.982015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:41.983380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:41.996015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 258/518] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:41.996845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.000339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.001134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.001416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.001692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.012767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.014252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:42.031707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:42.032680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 261/519] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:42.034081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.063338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.100865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33bbe-d54c-47ff-af19-b44568d4e781 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.102531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.132986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72434b-7938-4823-b918-b0fc8bead5c5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.136588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.137345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.137631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.137933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.138765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:42.139077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.140522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.157666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 259/520] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:42.158587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.167317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.167994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.168280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.168560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.169311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.170784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.261473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cce6-1bfb-4358-8220-c6f15aaa0aca None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.262585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 262/521] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:43:42 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:43:42.263418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.296912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.309302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.310160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.310481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.310725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.311591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:42.311931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.313569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.335000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 260/522] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:42.336487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.383295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85bb36-e0ce-4957-b880-b2ed654b7490 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.415066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.423517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.424820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.430201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.430201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.435880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.437645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.451401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6d92-78fc-436a-99fe-72a11009a0ce None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:42.454666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:42.455550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 263/523] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:42.456712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.496492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.497174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.497449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.497735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.498506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:42.498853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.501353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.516428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 261/524] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:42.517719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.566159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.585758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730bcdd-5fb3-4897-b753-9894b953a552 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.620850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.621504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.621781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.622078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.623142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:42.623457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.624868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.625986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f47f-ec28-42a1-9fd9-1fb41519df7b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.637924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 264/525] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:42.637924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.673793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.675582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.675582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.675582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.717561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.760263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.761857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.793051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addbbcc-2cbe-4a40-aa3b-e6d5baed6dba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:42.824342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:42.848091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:42.849266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:42.849705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:42.850501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:42.852413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:42.852898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:42.854582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:42.880341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 265/526] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:42.880546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:42.906137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 262/527] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:42.907020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.004841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96b8a-0383-44b7-9245-7d6385b1a1b1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.012732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5caf6a-009c-4626-98de-70fd62c5c36a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.019613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.049148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.049844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.050321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.050503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.061205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.062370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.062847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.063376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.064629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.072286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.073835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:43.088252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:43.089281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:43.090364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:43.092073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 266/528] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:43.097206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.139523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.141109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.212787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2843f3-c9ab-4e4f-bbd3-f2ddd1c0f436 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.247101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 263/529] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:43.247873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.256426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.257651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.258177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.258680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.270680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.272486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.292907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:43.295301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:43.296132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:43.296948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:43.296948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:43.296948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:43.296948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:43.299529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 267/530] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:43.307413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.333655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.354597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be49a-39b9-4623-baad-0a8f9e4e2d71 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.394955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.395703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.396055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.396418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.397279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:43.397651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.399980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.418175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 264/531] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:43.419181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.432225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353371b-7c79-420c-9e6a-5b2fc6b679bb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.477332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.478286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.478640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.478979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.491073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.492666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:43.514031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:43.515107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:43.516146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:43.516146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:43.516146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:43.516146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:43.517936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 268/532] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:43.518902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.538071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69d94d-3151-4cc9-9c65-5abc45829205 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.540447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.581757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.583444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.584353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.585087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.586805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:43.587200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.589372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.608770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.608942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 265/533] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:43.608942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.637267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e34390-b330-4d42-bdf9-f2e5aee3880e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.675997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.676936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.677408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.677825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.679042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=fc9e81f64b024659aea31521c6f5fb03) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:43.679560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.681216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.688026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 269/534] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/role_assignments?user.id=fc9e81f64b024659aea31521c6f5fb03&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:43.689137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.721502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736f696-cce3-4518-9d1b-c47507c12c63 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.771998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.773083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.773448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.775184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.775725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:43.776037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.777466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.808067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 266/535] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:43.816224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:43.865937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.875983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb72ea-a921-4602-af28-fce646037b60 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:43.913398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:43.914828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:43.915110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:43.915390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:43.922727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:43.924192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:43.926126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:43.940148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:43.941864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 270/536] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:43.951158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:44.030952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c1a3e-8c7e-424d-bc47-653acad4eac3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:44.061753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff71ed8-c6a8-4df5-b0cd-91097b617124 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:44.104797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:44.105624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.105920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.106200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.118570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:44.119229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.119512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.119793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.120862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:44.121171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:44.123609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:44.126419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:44.127992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:44.157930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:44.158801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:44.159625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:44.160025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 271/537] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:44.160025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:44.162106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 267/538] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:44.167782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:44.231105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:44.268250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:44.277040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6df4f-07c2-4ea1-866f-2f9142ff7c18 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:44.300699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428511-7e86-4bb9-a363-6e625acb7ddb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:44.339177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:44.339899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.340181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.340460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.341312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=fb92fb4d1d124af781f1dc10ca2cb4a8) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:44.341620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:44.343105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:44.366740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 272/539] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:44 2022] GET /identity/v3/role_assignments?user.id=fb92fb4d1d124af781f1dc10ca2cb4a8&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:44.376987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:44.377641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.377956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.378239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.379103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:44.379415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:44.380930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b0df-e520-4dd1-8ae7-1178011bf520 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:44.404527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 268/540] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:44.414467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:44.584262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2756-4e42-4e16-82f6-53109c1091b1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:44.613373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:44.632131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:44.632754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.633039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.633317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.634189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0773ba9f520f432c88ae86143c91b9f2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:44.634502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:44.636019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b683c94-e73e-416e-a199-759a1e597302 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:44.644691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 273/541] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:44 2022] GET /identity/v3/role_assignments?user.id=0773ba9f520f432c88ae86143c91b9f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:44.839860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14ce6-8cd4-400b-baad-82c6193bbdf2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.840526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14ce6-8cd4-400b-baad-82c6193bbdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.841099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14ce6-8cd4-400b-baad-82c6193bbdf2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.843466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 269/542] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:44.852559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:44.853187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:44.853668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:44.883271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:44.884847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:44.982598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 274/543] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:45.007036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14ce6-8cd4-400b-baad-82c6193bbdf2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.126610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14ce6-8cd4-400b-baad-82c6193bbdf2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:45.176165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:45.176899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.177191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.177532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.189454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-021e268c-f156-41ef-87df-c5e2e3deea50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:45.198069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:45.198976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:45.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 270/544] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:45.205410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.313063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330bc0-a3b3-43e1-85c1-e07aca8c1109 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:45.331769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:45.336234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f792f7-ff1f-48e6-bdaf-070a78d130a4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.336565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f792f7-ff1f-48e6-bdaf-070a78d130a4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.336794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f792f7-ff1f-48e6-bdaf-070a78d130a4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.338895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 271/545] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:45.346816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.346816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.346816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.351755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:45.365255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:45.365906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.366195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:45.366365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.366532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.367250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:45.367539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:45.367712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:45.368886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:45.382105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 275/546] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:45.399983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.455046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 272/547] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:45.481665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.602601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c158b9-a58f-49e2-891a-fb5e662de015 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:45.638911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:45.640011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9ecb-4408-48ea-87bb-b2ff7b0d1fea None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:45.644483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:45.645340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.645689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.646018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.658932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:45.668620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:45.669517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:45.670837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:45.675554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 273/548] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:45.676561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.780722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:45.781499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.781782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.782079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.790471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75cdd2-5cff-4402-810e-1cffa971819b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:45.822805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:45.824288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:45.828250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:45.828937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:45.829226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:45.829507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:45.830455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:45.830770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:45.832179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:45.846608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 274/549] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:45.848324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:45.870811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:45.871735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:45.872666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:45.872666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:45.872666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:45.872666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:45.878384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 276/550] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:45.890925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:45.938251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:45.961084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:45.987762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da3d39-5273-47fa-a164-493bca27a85a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.063587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.064299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.064579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.064853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.082509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.083986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.113059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd295bd-56c0-4b40-8258-f1b25a18b31b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:46.118487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:46.119374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:46.120496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:46.120496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:46.120496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:46.120496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:46.125005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 275/551] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:46.131362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.185490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.186229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.186506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.186777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.187551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:46.187859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.189240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.214401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 277/552] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:46.219704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.319673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3d1e5-4415-4aa1-b7d6-d369424e8168 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.364807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.365481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.366084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:46.366642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.367468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.369036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:46.369698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.371596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a071-e6c0-4eb8-900c-6acc1e8692f9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.388267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 276/553] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:46.394677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-5bc2-454e-a57f-72851156521b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.394928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-5bc2-454e-a57f-72851156521b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.395207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-5bc2-454e-a57f-72851156521b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.396625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 277/554] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:46.397210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10c1-5bc2-454e-a57f-72851156521b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.415978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:46.426627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587f414-fdcf-4d52-b7db-4615d8ee6e7b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.464898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.466260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.466827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.467300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.475779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.478192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7fab1371-7a71-4d63-87e9-1a5111bde5db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:46.494698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:46.496074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:46.497054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:46.504380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 278/555] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:46.506137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.506642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.507214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.511593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10c1-5bc2-454e-a57f-72851156521b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.527025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:46.528524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:46.548438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.549240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.549523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.550072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.557855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.559358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:46.575530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:46.576477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 278/556] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:46.577842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.615926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:46.619780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 279/557] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:46.621194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.697866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f775-ab78-43b1-a7ec-9955a1544c21 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.715074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:46.734829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210f5eb-bfcd-47fe-b72c-454a0ae60ef4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.737047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.737975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.738471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.738997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.740109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:46.740617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.742435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.762228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 279/558] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:46.763638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.772435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.774068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.774181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.774391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.775240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:46.775544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:46.777257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:46.805350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 280/559] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:46.806572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.865597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:46.883969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432d2d-69a0-4361-8d35-a93ef23a1bd0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.925129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.927705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7402e-e3bd-431e-afab-8028267e8a18 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:46.928541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.929153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.929658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.942400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:46.951145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:46.952068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:46.952874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:46.955735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 280/560] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:46.956932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:46.969204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:46.970206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:46.970690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:46.971629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:46.983144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.059363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.061558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d109b-b1c5-4d4c-b370-46735072e459 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.089354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007cc6b-409d-43fe-a5d1-b7910529ac5a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.127020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.128386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.128853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.129326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.141928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.143844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.146967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:47.163723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:47.164650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:47.165531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:47.165531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:47.165531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.165531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:47.167916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 281/561] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:47.169002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.169225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 281/562] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:47.170695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e5b8-d30d-4d16-be9c-4335a87710c3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.170984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e5b8-d30d-4d16-be9c-4335a87710c3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.171258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e5b8-d30d-4d16-be9c-4335a87710c3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.172606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 282/563] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:47.173557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e5b8-d30d-4d16-be9c-4335a87710c3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.216852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.279397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67e4cb-1631-4dcc-a14d-4e864b659464 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.279737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e5b8-d30d-4d16-be9c-4335a87710c3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.313622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.313847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.314325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.314448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.314616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.314741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.314923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.315065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.315705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:47.315798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:47.316017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.316118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.317388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e007b-5d70-4fe2-8295-39e6a353b925 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.317478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.325915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 282/564] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:47.326800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.329564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 283/565] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:47.331152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf58b-a1f2-4180-8cb6-fb08cd2e5e6d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.331445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf58b-a1f2-4180-8cb6-fb08cd2e5e6d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.331729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf58b-a1f2-4180-8cb6-fb08cd2e5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.348977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-58dbf58b-a1f2-4180-8cb6-fb08cd2e5e6d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:47.350211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-58dbf58b-a1f2-4180-8cb6-fb08cd2e5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:47.385820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.417097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 284/566] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:47.418423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8551d2-63f1-47a8-a494-0590aaf5f466 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.418720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8551d2-63f1-47a8-a494-0590aaf5f466 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.419006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8551d2-63f1-47a8-a494-0590aaf5f466 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.420516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 285/567] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:47.421222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8551d2-63f1-47a8-a494-0590aaf5f466 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.430150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8743-f8e4-41e9-be45-ea5bc512a120 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.454805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.464514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.465309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.469719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.469719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.476709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.478182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:47.495760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:47.496666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 283/568] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:47.497718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.530715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8551d2-63f1-47a8-a494-0590aaf5f466 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.563526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.564324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.564607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.564882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.576344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.577792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a7ed7366-ef18-44d8-af1b-95139be9b505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:47.596288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:47.597354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:47.598468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:47.598468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:47.598468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:47.598468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:47.598468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 286/569] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:47.599010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.599294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.599569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.602904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187515bc-13e9-45d4-a57f-6b39330fc09b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.613449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.616471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:47.617691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:47.636558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.637285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.637568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.637842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.644475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.645954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:47.661875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:47.662971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:47.664083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 284/570] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:47.664961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.688707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 287/571] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:47.689554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.701592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.763421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e14c-fcf7-4fe9-848d-7d80efb2c7eb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.798502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac095bd-c59b-4bfc-adb3-5332ececff63 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.799278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.800079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.800362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.800637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.811052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:47.818930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:47.819871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:47.820709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 285/572] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:47.821396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.836731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.837408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.837696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.838066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.838806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:47.839115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.840533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.851828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.852451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 288/573] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:47.853261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.919009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7faec-8d8c-4c37-b220-cd7499923c35 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.921225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:47.951427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3f33-b21e-4610-8932-0f74a14f82cf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:47.953361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.954065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.954347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.954625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.955435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:47.955748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.957137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:47.968804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 286/574] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:47.969610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:47.986521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:47.987189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:47.987504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:47.987780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:47.988574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:47.988883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:47.990359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.003209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 289/575] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:48.004015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.062164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.071738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54beb0-9953-405c-bce3-15dbb416d88c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.102474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98ad3-aa93-4c59-a06f-0ea348d06e7d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.105378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.106202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.106486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.106759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.116695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:48.124675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:48.125698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 287/576] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:48.126616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.135948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.141744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.142528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.142815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.143094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.143908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:48.144220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.145600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.154150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 290/577] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:48.154946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.225746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaec15-abaa-4642-b5f4-489442f1d2b0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.252378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99d4c-4874-447e-b1db-5d4ca30b01ed None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.264999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.265792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.266110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.266386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.273603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.275083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.286263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.287060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.287345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.287623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:48.288997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:48.290005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:48.290869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 288/578] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:48.291349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.300329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.301777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.302647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:48.316316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:48.317420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:48.318435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:48.322040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 291/579] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:48.323053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.375434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.399021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c37bc-acf1-44cd-b5bf-52ff19f20a9d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.422366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677ad2a-0602-4d9f-b793-76d6e633d2a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.432618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.433500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.433781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.434093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.448672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=0ac9c94438bf4a0b8a603d472ca317f2, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.450140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.456026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973baf44-f87d-4755-9873-916043507d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.456688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baf44-f87d-4755-9873-916043507d84 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.456972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baf44-f87d-4755-9873-916043507d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.457247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973baf44-f87d-4755-9873-916043507d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.458025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973baf44-f87d-4755-9873-916043507d84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:48.458336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973baf44-f87d-4755-9873-916043507d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.459695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973baf44-f87d-4755-9873-916043507d84 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.467575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 292/580] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:48.468428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973baf44-f87d-4755-9873-916043507d84 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.522650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 289/581] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:48 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:48.524117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.579641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973baf44-f87d-4755-9873-916043507d84 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.595224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.604902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.616346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.619031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.619031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.619031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.630169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.631687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:48.650887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:48.652032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 293/582] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:48.661179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.664142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279ef6-db97-4ab9-9b31-9f0413cca6cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.701246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.701997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.702304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.702650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.703503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:48.703823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.705294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.720893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 290/583] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:48.721752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.775173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb563eef-2ae7-4f31-ba79-f3d58560ca81 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.816953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.817742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.817948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.818231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.819084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:48.819397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.820914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.835013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2151b-431d-4b22-be04-c5ac3d840d84 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.839052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 294/584] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:48.839904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.860333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.868318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:48.875622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.877952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.877952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.877952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.888148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.889822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:48.907469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:48.908541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:48.909632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:48.909632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:48.909632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:48.909632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:48.911869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 291/585] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:48.912821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:48.956629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9676a6-ba08-47ec-b993-00597288602a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:48.995067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:48.995736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:48.996019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:48.996297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:48.997034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:48.997346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:48.998752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.011266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 295/586] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.012131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.037570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1a96c-e2f5-411b-89a6-d1b1080c5ac3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.073493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.074183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.074456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.074736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.075576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=8411904e69324169ad7f8907297f650c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:49.076079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.077333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.083243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 292/587] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:48 2022] GET /identity/v3/role_assignments?user.id=8411904e69324169ad7f8907297f650c&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.084344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.110895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.131102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423f3ab-98ca-4963-a983-d659c0a574c0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.136451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.171046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.172348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.172727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.177259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.188244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.190716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.209813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948ec1-c893-4f7b-9c41-012f28dcff56 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:49.216784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:49.218074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:49.220377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:49.220377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:49.220377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:49.220377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:49.220377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 296/588] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:49.221398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.267859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.268711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.269125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.269803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.271683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:49.272176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.273747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.295649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 293/589] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.295649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.359444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72301-f219-4b12-83b7-2c29410fb86a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.405247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.406228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.406514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.406790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.407177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.410206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.414962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9c15-3197-42ca-a06f-d651824f28bd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.416622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.417746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:49.437233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:49.438248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:49.439182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:49.443216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 297/590] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:49.444171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.463633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.464586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.464883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.465166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.465933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:49.466245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.468090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.484143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 294/591] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.485232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.563606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f90606-a4a0-4b83-9b52-ca71ed1aaac1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.602778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.604022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.604503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.605000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.613310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.613455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82eca6-63f1-4df5-beec-ffccc78ed346 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.615805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:49.633015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:49.634044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:49.634968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:49.637349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 298/592] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:49.638435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.653504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.654232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.654520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.654837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.655868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:49.656188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.658216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.685996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 295/593] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.687396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.706721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.709297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.758673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584cb65-df33-4855-8971-6b77f68a44da None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.804856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.805665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.805996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.806280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.813856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.815332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.818690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38336b-ce92-44ea-860a-c9b9a35bac6f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:49.830537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:49.831796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:49.832751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 299/594] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:49.833305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.867928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.869041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.870114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.871530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:49.872616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:49.873130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:49.874832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:49.901155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 296/595] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:49.902614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:49.946848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523f515-27ac-4e31-9c1c-2a12e9be7594 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:49.964645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.988249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:49.989831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:49.991303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:49.992894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:49.993762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.009011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.011425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.022622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b288c-3326-4dd7-9b88-54e568380ebc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:50.035623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:50.036524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:50.037433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:50.037433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:50.037433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:50.037433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:50.040200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 300/596] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:50.041243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.060272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.061107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.061488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.061926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.063117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:50.063235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.064884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.082180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 297/597] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:50.083184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.181178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546594e-7f9c-4e4d-b44a-6389251f1c74 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.203142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9641d43-07c0-473b-84a5-446c1169f67a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.245657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:50.260576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.263022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.263022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.263022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.265915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:50.265915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.269915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.273921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.273921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.273921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.273921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.305932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.305932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.306199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 298/598] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:50.306199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:50.338003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:50.339025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 301/599] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:50.339889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.414269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:50.503876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17353-b98a-45af-85f7-1dd166054512 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.549752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e13165-4210-4c51-ae80-31146714cf9b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.578536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.579449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.579727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.580001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/fc9e81f64b024659aea31521c6f5fb03/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.608294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=fc9e81f64b024659aea31521c6f5fb03, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.613201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.625923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.625923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.625923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.625923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.633914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.633914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:50.646856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:50.648329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:50.649309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:50.652412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 302/600] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:50.652412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.694411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 299/601] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:50 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/fc9e81f64b024659aea31521c6f5fb03/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:50.695628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.800332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:50.808036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:50.874029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0cb1-c29e-495e-9c05-f707d01eeafd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.892018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db45b-6b5e-471a-b1e9-76caaa1ffc8f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:50.922837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.924691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.925365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.926006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.927329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:50.928332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.930864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985470d-07fb-474a-8767-986e140ac8d1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.939915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:50.940663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.940965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.941219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.941999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:50.942315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:50.943723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff64b66-8e47-4f48-81ad-1bcf3e41e464 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:50.948539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 300/602] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:50.955651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546047c-d766-42a6-9988-d9d668399224 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.955651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546047c-d766-42a6-9988-d9d668399224 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.955651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546047c-d766-42a6-9988-d9d668399224 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.956632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 301/603] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:50.964702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546047c-d766-42a6-9988-d9d668399224 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:50.965120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 303/604] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:50.967658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:50.967658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:50.967658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:50.990340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:50.991960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:51.074412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 304/605] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 20:43:51.075536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.110962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546047c-d766-42a6-9988-d9d668399224 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.112636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.148261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.149287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.149584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.149924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0773ba9f520f432c88ae86143c91b9f2/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.160633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.166357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=0773ba9f520f432c88ae86143c91b9f2, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:51.171962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:51.190896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bf8b6-e5cd-405c-bee2-036ac9e8d6d9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.227807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.228604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.228884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.229156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.236151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:51.237620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:51.251925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:51.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:51.253692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 305/606] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:51.254722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.318805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 302/607] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:50 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0773ba9f520f432c88ae86143c91b9f2/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:51.320521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.417715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fc5f4-e5ec-44b5-b1c4-4c9ff88f70f9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.458107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.462842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2ad28-6e21-4070-b6ae-d4fb60c4f7c3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.464438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.465495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.472353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.472353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.482030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2bd05354-3109-4dee-90d8-bedee88b21c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:51.492582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:51.493763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:51.495174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:51.502432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 306/608] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:51.504503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264af0f-e98f-4948-bb59-947e7fc639ee None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.504795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264af0f-e98f-4948-bb59-947e7fc639ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.505076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264af0f-e98f-4948-bb59-947e7fc639ee None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.506959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 307/609] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:51.508278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264af0f-e98f-4948-bb59-947e7fc639ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.516848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.517971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.518473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.519522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.520543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:51.521079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:51.523526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cebff-fe7f-40e3-8ee0-83b3074f2d75 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:51.538778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 303/610] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:51.540586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.541014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.542739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.562097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:51.563316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:51.574945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.631208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264af0f-e98f-4948-bb59-947e7fc639ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.649349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 304/611] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:51.650459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.667126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.668154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.668615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.669079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.670046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:51.670541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:51.671911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:51.681274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 308/612] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:51.686015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.747847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.782273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d997f0-4787-4559-b4b5-15b759d529b1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.805617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67e66-01ed-4f19-8d6f-f63df4e2b71b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:51.826313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.827762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.828281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.828790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/fb92fb4d1d124af781f1dc10ca2cb4a8/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.842916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:51.846652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=fb92fb4d1d124af781f1dc10ca2cb4a8, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:51.848377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:51.850439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:51.851811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:51.852071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:51.852335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:51.864443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:51.873219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:51.874390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:51.875235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:51.879204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 309/613] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:51.882344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.985495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 305/614] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:51 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/fb92fb4d1d124af781f1dc10ca2cb4a8/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:51.985495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:51.990060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea58a0e-7cbb-4bdb-a679-fd3d072655c1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.018456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:52.067027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.067841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.068121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.068393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.086721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.088190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:52.124510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:52.125458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:52.126343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:52.126343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:52.126343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:52.126343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:52.131675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 310/615] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:52.135267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.191298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa646a-2c9c-44a9-8e1b-cf2491c3c1cf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.260655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.261248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.261528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.261837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.262702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:52.263007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.264377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.279729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 306/616] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:52.285703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.319218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2236a4-9f1c-40cf-96ce-641f482ec86e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.385998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:52.386336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.387152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.387274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.387511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.388249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:52.388560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.390079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.421540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 311/617] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:52.426591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.468898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:52.481052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fdebd-59bc-4da0-ba5c-4acbe6cb9679 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.549288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.550043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.550329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.550605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.564094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.565828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:52.587069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:52.588041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:52.589104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:52.589104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:52.589104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:52.589104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:52.589104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 307/618] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:52.594843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.636849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87958-f12b-4715-ba7a-d48aee8a2bdb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.709656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.710910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.711425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.711977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.729745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.731814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:52.760904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:52.761933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:52.762878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:52.772898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 312/619] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:52.778319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.802276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb24ae4-d2b0-47d0-8bbb-5532b60f2e06 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:52.816514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:52.871684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:52.872362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:52.872650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:52.872931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:52.873667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:52.873999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:52.875449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:52.900932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 308/620] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:52.906784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:52.950737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:52.971981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e1f6f-71f6-4259-9053-dd19fd6e4eba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.016237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.016991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.017199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.017476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.019533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:53.019849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.021288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.063234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 313/621] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:53.068105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.179891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee2056-9809-4b83-8a7b-7e83c16f7932 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.185738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b1012-9cb6-49dc-8fa0-145be533e2fc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.244137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.245063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.245341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.245614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.246819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.247600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.247875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.248148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.262531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.263986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.286258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8b5a27cb-3c6a-46da-ba1c-a9263009ff58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:53.289603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:53.290553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:53.291490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 309/622] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:53.292552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8626a-a220-4177-9858-1e6f1804830b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.292664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8626a-a220-4177-9858-1e6f1804830b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.297349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8626a-a220-4177-9858-1e6f1804830b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.302669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 310/623] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:53.302669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8626a-a220-4177-9858-1e6f1804830b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.337365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.357833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.359742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1dc32-38d5-4114-9b65-1e0d37c466b1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.416893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8626a-a220-4177-9858-1e6f1804830b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.463964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.464643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.464928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.465208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.466091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:53.466404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.468630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.484573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 314/624] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:53.486058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.486354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.486640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.489201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 311/625] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:53.490155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.512017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:53.513251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:53.562455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.594330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 315/626] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:53.595190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.599595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.616459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a3005-ce3d-4545-8db4-57b489099dcd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.661194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.662733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.663054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.663338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.679601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.682934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:53.707057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:53.708011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:53.708895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:53.708895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:53.708895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:53.708895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:53.713235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 312/627] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:53.714168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.730358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1fa7-31de-4449-ab25-60c8909b013c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.784177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.785624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.786538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.786832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.804516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:53.806027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:53.827648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3b749-8503-4203-ab09-029d2af02384 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:53.828954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:53.829874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:53.830791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:53.830791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:53.830791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:53.830791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:53.830791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 316/628] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:53.831464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.860687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.871385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:53.872307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.873549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.873549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.876768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:53.885697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-581276b7-3847-4bb0-95a5-b5ad0afe01f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:53.893455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:53.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:53.895418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 313/629] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:53.896420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258dbf4-e051-493f-b4bd-7407dd669fd1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:53.896715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258dbf4-e051-493f-b4bd-7407dd669fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:53.896996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258dbf4-e051-493f-b4bd-7407dd669fd1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:53.898444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 314/630] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:53.899059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258dbf4-e051-493f-b4bd-7407dd669fd1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:53.961640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721736c-bb22-4c21-b803-1712c7924813 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.001571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.002541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.002976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.003464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.004501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.004974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.006617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.018812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258dbf4-e051-493f-b4bd-7407dd669fd1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.024950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 317/631] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.026467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.060185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.060982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.061265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.061545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.062316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.062620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.063999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892dd10-8fca-4db9-b578-ae31babea190 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.081750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 315/632] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.081750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.081750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.081750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.098104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:54.099301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:54.136546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.153655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efe78c-1d0b-4d23-8e46-34d0ace6fe22 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.157203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.185920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 316/633] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:54.185920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.195311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.195999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.196281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.196561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.197328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.197638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.199041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.209442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 318/634] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.211702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.300982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ede6bf-fe42-4712-a7f6-c3e252d01353 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.323752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01523-6009-4d80-8afd-3fefa54def36 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.338862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.339672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.339959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.340226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.347144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.348608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:54.362383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:54.363300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:54.369258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:54.370033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.370033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.370183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 317/635] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:54.370265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.370265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.370402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.378007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.379564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:54.395827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:54.396924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:54.398447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 319/636] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:54.398937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.408363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.424712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.481493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f195b-b732-4e0c-80d0-edd911baa690 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.513858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ebc17-cb1d-4328-8312-fa3ada5cddc4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.517877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.518710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.518996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.519274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.531118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:54.539162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:54.540196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:54.541028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 318/637] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:54.541706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.554977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.555787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.556072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.556346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.567404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.568856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:54.587443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:54.588418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:54.589307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:54.589307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:54.589307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:54.589307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:54.589307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 320/638] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:54.589589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.648282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.653743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90712-de87-4184-8c1b-53c864a6c4f9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.660508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.686259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.686918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.687196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.687468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.688247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.688550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.688900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef2f08-f550-4500-8b9b-4213538abb38 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.689990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.702382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 319/639] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.703177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.729816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.730506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.730806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.731061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.731843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.732148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.733590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.745735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 321/640] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.746572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.804722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55009c-35c5-4637-99bd-5933bdc29935 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.839294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.839968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.840254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.840597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.841371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.841677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.843083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75276c-f480-4de4-8b5f-ea363b702139 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.851641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 320/641] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.852921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113934ca-5172-4d17-9117-f9beb3c9b22f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.853214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113934ca-5172-4d17-9117-f9beb3c9b22f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.853494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113934ca-5172-4d17-9117-f9beb3c9b22f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.853873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda203b-d89f-4501-9a15-b3f0bbc88af5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.854913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 321/642] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:54.858669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113934ca-5172-4d17-9117-f9beb3c9b22f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.872575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.887839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:54.890003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.890675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.890961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.891244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.891979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.892288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.893655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:54.905942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 322/643] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:54.906661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:54.960699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113934ca-5172-4d17-9117-f9beb3c9b22f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:54.995549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:54.996285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:54.996570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:54.996844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:54.997670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:54.998004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:54.999432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.005306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 322/644] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:54 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:55.006312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.007109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75df9a1-fc3e-4234-aa18-55d4f2bd91a4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.064660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.066172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.066461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.066899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/8411904e69324169ad7f8907297f650c/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.089132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=8411904e69324169ad7f8907297f650c, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.091233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.107783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.117336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13a269-ac46-4c31-bb92-e0741a1fbe87 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.152571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.153384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.153670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.153974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.165615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.167051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7ff7c1aa-90c7-4fd9-a70c-84b624f9434e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:55.185408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:55.186524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:55.187565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:55.187565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:55.187565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:55.187565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:55.187565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 323/645] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:55.188078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.188199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.188477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.203419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 323/646] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:43:54 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/8411904e69324169ad7f8907297f650c/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:43:55.204258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.206573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:55.209376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:55.250114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.299688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 324/647] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:55.300923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.357320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b529df-d4c4-4f5b-a460-44027507f406 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.399193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.404801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.406158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.407024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.429224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.429224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.429224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.429531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafd68-45fb-4149-aa39-be8a0d39a824 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:55.439651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:55.440916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 20:43:55.442072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:55.444031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 324/648] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:55.444985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.468740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.469468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.469751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.470505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.471242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:55.471551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.472934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.486591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 325/649] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:55.487739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.561512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.576235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8679b3-32cc-4c54-b5b2-39baa84861d4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.614799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8523-b947-44b8-bef5-3dc8ded1bfa1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.619583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.620457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.620734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.621007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.634811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:55.644773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:55.645749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:55.646953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 325/650] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:55.648673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.661251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.662671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.663017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.663290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.664134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:55.664441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.665862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.668098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.696049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 326/651] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:55.696049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.776684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2af37-ffd1-4011-ba59-e922997a1fd9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.800252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802316d-8fc4-49d9-8d98-195b712f2585 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.821030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.822283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.822780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.823291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.832561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.834800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.836483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:55.837245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:55.837595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:55.838048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:55.838868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:55.839627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:55.840652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:55.849594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 327/652] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:55.850567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:55.853611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:55.854554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:43:55.855559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:55.857983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 326/653] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:55.859054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:55.872004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.909597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:55.961644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0520-68f9-4e0f-ba17-6b14fbeee0f0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:55.972093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f90a46-c2b4-4407-b5f2-977529ec1fab None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.008126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.008913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.009297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.009669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.018607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.020172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.020599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.021036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.036906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.039225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:56.062535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:56.063613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:56.064665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:56.064665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:56.064665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:56.064665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:56.066383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 327/654] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:56.067330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.093947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.096207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.129399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.167562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.187700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88c5b-f298-4a4d-b483-f322fc3fef03 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.220934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 328/655] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:56.220934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.239069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.240377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.240807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.241762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.242781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:56.243231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.245887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.269591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 328/656] 10.222.0.55 () {56 vars in 1137 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:56.270780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.336938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a01a0a-bb46-4dc4-84db-ad41c6140487 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.379530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.380481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.380908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.381327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.382392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:56.383324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.385180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.395818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc81cf-3d05-4f2d-9448-eb2d4d04d606 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.402464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 329/657] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:56.403499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.415930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.428603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.436626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.437687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.438151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.438705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.449385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.450845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:56.471105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:56.472221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:56.473349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:56.473349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:56.473349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:56.473349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:56.479539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 329/658] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:56.479539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.546493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310937e1-c8c9-4766-af0a-9a6b5c49a6aa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.583352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.584178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.584563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.584967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.601019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a5f7-d247-49d6-a1a0-889d17b23008 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.646798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.648666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.649499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.649943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.659570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.659833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.661254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.661556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.677524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:56.682377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:56.683473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 20:43:56.684634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:56.687288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 330/659] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:56.688513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.726538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.773879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 330/660] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:56.779338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.826066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27af38-d4f5-4aee-94a2-44aee5169718 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.872179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.873526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.874207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.874651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.875762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:56.876215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.878640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.901005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e132e-eb82-4578-b3c4-27a89fde6735 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:56.902059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 331/661] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:56.904096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:56.917015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:56.938212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:56.939071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:56.939447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:56.939824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:56.940905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:56.941345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:56.943132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:56.965670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 331/662] 10.222.0.55 () {56 vars in 1139 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:56.967058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.026501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.040395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551dcbe-28aa-4f7e-ad55-b06506e785e7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.077186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a406e8e-45b1-4c97-bf97-5e8eb08ca07f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.086951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.088868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.089769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.090270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.105175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.108009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.115645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.116611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.116966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.117315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.127521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.129230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:57.137426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:57.138413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:57.139285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:57.139285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:57.139285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:57.139285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:57.141766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 332/663] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:57.142906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:57.151209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:57.152130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:57.153039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 332/664] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:57.154236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.191137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.272152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ec45-d43b-42ae-9b0b-88ec22afaa56 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.282289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2debd93-4773-42bf-85fe-32fde6037e1d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.312836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.313258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.313540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.313852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.330587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.331064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.332241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.332529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.332809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.333601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:57.334000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.335945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.353130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 333/665] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:57.354079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.404671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.407212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.455276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.466182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2675c6a-4256-4b61-85bc-be85a50dc4a4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.507707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.508464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.508750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.509022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.509815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:57.510172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.515233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 333/666] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:43:57.515388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d799e3-8f76-4c7b-8a98-7a4b95c1ee75 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.515479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.526609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 334/667] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:57.531372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601945-0d7b-458c-bb23-181c2c3106e5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.531662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601945-0d7b-458c-bb23-181c2c3106e5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.531942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d601945-0d7b-458c-bb23-181c2c3106e5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.533262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 335/668] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:57.533923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d601945-0d7b-458c-bb23-181c2c3106e5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.564697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.623093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce83c1-6a5a-4c87-86aa-3f81dcf23d66 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.640939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d601945-0d7b-458c-bb23-181c2c3106e5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.657663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.658484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.658765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.659035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.665543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.667046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.673122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.673918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.674205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.674479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:57.680871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:57.681788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:57.682713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 334/669] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:57.683197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.687482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.689032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5a91cea3-43ab-48b4-a188-70631fe3f04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:57.706616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:57.707562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:57.708430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:57.708430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:57.708430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:57.708430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:57.708430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 336/670] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:57.709021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de06901-eba5-43e3-a27d-ddea4b7611c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.709262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de06901-eba5-43e3-a27d-ddea4b7611c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.709537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de06901-eba5-43e3-a27d-ddea4b7611c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.715096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.725492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6de06901-eba5-43e3-a27d-ddea4b7611c3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:57.726712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6de06901-eba5-43e3-a27d-ddea4b7611c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:57.787665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322ee0-8f15-4b87-830d-b972fbcc1a65 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.789693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.799068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 337/671] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:57.799666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed141-474b-4a83-8f68-80b694b7c459 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.799963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed141-474b-4a83-8f68-80b694b7c459 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.800244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed141-474b-4a83-8f68-80b694b7c459 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.801509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 338/672] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:43:57.802245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ed141-474b-4a83-8f68-80b694b7c459 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.827109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.827771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.828061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.828345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.829236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=fc9e81f64b024659aea31521c6f5fb03) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:57.829887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.832299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.838237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 335/673] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/role_assignments?user.id=fc9e81f64b024659aea31521c6f5fb03&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:57.839030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:57.925048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ed141-474b-4a83-8f68-80b694b7c459 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.964203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:57.964874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.965181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.965526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:57.966124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae4e-4183-4a5d-bd53-4ddf3f0b1a55 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:57.966378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:57.966727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:57.968187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaedf9-f4d1-4b7a-b0e6-653074ed0cf4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:57.970249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:57.986934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 339/674] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:57.986934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:57.986934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:57.986934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.005517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:43:58.007143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:43:58.012707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.013386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.013668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.013965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.014704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.015006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.016404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.029838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 336/675] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.030555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.065600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.094622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 340/676] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:43:58.095381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.153464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e0453-ff47-43be-823f-58fa4a3c00f1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.192300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.193184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.193533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.193876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.204418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:58.207416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608afd0-1e14-44dc-82f0-7298126f5b61 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:58.212597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:58.213520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:58.214742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 337/677] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:58.215447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.239834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.254152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.254908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.255192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.255469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.256303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0773ba9f520f432c88ae86143c91b9f2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.256646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.258639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.275506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 341/678] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/role_assignments?user.id=0773ba9f520f432c88ae86143c91b9f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.275506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.315268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.334332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846f43b-9aa0-45d5-b5e1-2d09af7e5160 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.378804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.379621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.379903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.380175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.388041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.389499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:43:58.405421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:58.406433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:58.407309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 338/679] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:58.408359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.424771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd027ac-0fb1-4c62-b056-7b9aae2720ac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.466282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.467099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.467470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.467761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.484446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:43:58.494495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:58.495687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:58.496724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 342/680] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:58.497710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.524895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3df62-bc5c-4682-9462-fc5cfc660620 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.562478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.580277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.581315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.581799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.582506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.584001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.585396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.587198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.598539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 339/681] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.599858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.616564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.621886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750979d9-5113-4e54-afe9-0da31ed3fbfa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.661100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.662704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.663090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.663625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.664550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.665238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.666989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.684378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 343/682] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.685601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.724609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5364-c711-4fc9-8794-a0f4167d2aa5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.761160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.761871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.762188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.762465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.763218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.763521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.764873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.774569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 340/683] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.775421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.806460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c33-77a2-4046-b942-cb045cd9e583 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.817385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.846657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.847790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.848290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.849702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.850228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:58.862293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.864286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.881255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005351f3-83b0-4f4f-853a-ab6ccde23aee None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:58.885605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:58.886649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:58.887750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:58.887750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:58.887750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:58.887750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:58.889745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 344/684] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:58.890778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:58.918354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:58.918991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:58.919272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:58.919554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:58.920376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=fb92fb4d1d124af781f1dc10ca2cb4a8) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:58.920689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:58.922138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:58.928985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 341/685] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/role_assignments?user.id=fb92fb4d1d124af781f1dc10ca2cb4a8&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:58.929883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.036935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bbd16-7e2a-4954-9370-6cfb320f1857 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.075213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.075932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.076215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.076492 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.077242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:59.077550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.079023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.082409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.092515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596e4a4-3e4b-4ce9-b33b-66202c6d5f02 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.093715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 342/686] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:59.105062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.172858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.174401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.174902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.175182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.197731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.199389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:43:59.224754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:59.225789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:59.226722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:43:59.226722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:43:59.226722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:43:59.226722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:59.227929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 345/687] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:59.239673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.259498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.279589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eac83a-dc56-41a7-afb0-84686612a70c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.336842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.337680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.338008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.338402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.347067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.348498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.360272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b9273-ab37-4d8d-940a-2e5b13ff8e83 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:59.364887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:59.366477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:43:59.367480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:43:59.368053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 343/688] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:43:59.374097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.401948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.402961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.403470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.403948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.404884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:59.405393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.406983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.419937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 346/689] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:59.425653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.437867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.486314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57291f7-cc92-4388-8e36-2fc74781524d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.516204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.552157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7927-95ec-4cb4-8cb7-41d72a9358be None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.566647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.567504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.567906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.568346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.569307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:59.570087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.571344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.594196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.596186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.596627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.597082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.607012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.608801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.612738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 344/690] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:43:59.618566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:43:59.626763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:43:59.627712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:43:59.628719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:43:59.631919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 347/691] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:43:59.638530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.755248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ced95-25f1-49c6-84ab-cca1657ad47b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.785128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.803800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.804490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.804770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.805046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:43:59.805937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:43:59.806238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:43:59.807671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:43:59.815880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98948540-0dc6-4c15-80e6-b06c1a809dd0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:43:59.844723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:43:59.852970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 348/692] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:43:59.860444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:43:59.890735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:43:59.891307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:43:59.891722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:43:59.891841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.018198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.019668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.043982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db33f8-e9f2-4ee4-a216-a3e6360a6354 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.108518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.109183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.109442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.109712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.205825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 345/693] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:44:00.213416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.214296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.233339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.247359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.248850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f120-b203-47c8-8354-d003e986f04e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.371580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd91d-77dc-47f4-a4b5-8d8e373ba3e8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.419268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.421511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.422542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.423937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.443061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.444868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 349/694] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 20:44:00.449823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.449983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5c89-a396-4741-ae47-bfd5b3f2076d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.449983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5c89-a396-4741-ae47-bfd5b3f2076d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.449983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5c89-a396-4741-ae47-bfd5b3f2076d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.449983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 350/695] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:00.450962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce5c89-a396-4741-ae47-bfd5b3f2076d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-49fdf5e2-7445-4bde-a014-9d7829fc0a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:00.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:00.473602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:00.474728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:00.474728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:00.474728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.474728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:00.476333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 346/696] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:00.480671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.480671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.480671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.496296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:00.497693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:00.567371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.572769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.580631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 347/697] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:00.581927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.584297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce5c89-a396-4741-ae47-bfd5b3f2076d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.639286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.640117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.640401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.640689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.655296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.657033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:00.680769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:00.681706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:00.682621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:00.682621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:00.682621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.682621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:00.689153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 351/698] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:00.690313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.709772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb62ed1-40aa-4a2d-bd69-ffc5a0615325 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.748572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.749495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.749606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.749829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.750588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:00.750916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.752380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.765716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 348/699] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:00.766711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.812964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f687b9-46ee-4c2c-936d-4c1e23ffc22c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.828340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.848407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.849203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.849487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.849760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.863677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.865291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.867696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:00.878375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e784-ff71-4ec9-b789-607f928c4dd7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b87ae06f-c614-4afc-8f3a-70e8fa61178f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:00.884468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:00.885353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:00.886277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:00.886277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:00.886277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:00.886277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:00.886277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 352/700] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:00.887365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4da9-f1fc-4a51-a338-b5ff91a24646 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.887365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4da9-f1fc-4a51-a338-b5ff91a24646 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.887544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4da9-f1fc-4a51-a338-b5ff91a24646 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.888831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 353/701] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:00.893397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4da9-f1fc-4a51-a338-b5ff91a24646 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:00.919666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:00.920364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:00.920613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:00.920884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:00.921619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:00.921945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:00.923358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:00.941433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 349/702] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:00.941433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.004225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4da9-f1fc-4a51-a338-b5ff91a24646 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.042307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.043121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.043239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe13e-4cfa-4945-a45e-2fe9e729229e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.043405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.043668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.051136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.052734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.058029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5957033e-8c88-4329-a7f4-1f95be46f2b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:01.067824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:01.073862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 354/703] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.074855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.075481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.086262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.086930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.087208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.087480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.088202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.088386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:01.088513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.089590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:01.089840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.103004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 350/704] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:01.103713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.146417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.181926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 355/705] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:01.181926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.221822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f9d2-edad-49d9-be40-4743e1eaea11 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.257206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.257940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.258225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.258501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.265681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.267372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.278800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa7a39-117e-4193-8bd3-398e45030120 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:01.284091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:01.292742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 351/706] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:01.293858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.326225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.326904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.327184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.327457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.327632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.328255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.328559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.330007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.347777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 356/707] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:01.347777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.393055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.406216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf9b7a-9703-4e77-8e44-50862182f67b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.443947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.444895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.445322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.445739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.446793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.448596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.457611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d899-2929-4da3-af1f-0c8367e2ea1e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.495136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.495952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.496230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.496501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.497245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.498652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:01.512855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:01.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:01.519864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 357/708] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:01.521203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.535614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 352/709] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:44:01 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:01.535614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.649266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.664415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fd146-a151-466f-86f2-3fa3985c3cd5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.674439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a70a5c-059f-4dcd-9d55-e9dccfa1b1e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.687003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.715060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.715749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.716032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.716309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.716821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.717436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.717668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.718502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.719022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.719530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.720333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.721004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.721545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.724242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.732213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 353/710] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:01.733474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.750459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 358/711] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:01.757966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.872633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f85fba-7bc3-465d-9ff6-279b91da1610 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.893636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da8567-ab9c-40e8-a40e-c1d9dc7d1f37 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:01.919217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.919917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.920202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.920475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.921229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.922142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.924047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688aee6-2392-4f26-8f16-babf7a38b835 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.932988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 354/712] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:01.934586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d9db-f79a-4474-b5b2-09bbba89397f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.934949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d9db-f79a-4474-b5b2-09bbba89397f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.935231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1d9db-f79a-4474-b5b2-09bbba89397f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.936879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 355/713] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:01.938222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d9db-f79a-4474-b5b2-09bbba89397f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:01.942405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:01.943074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.943357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.943690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.945045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=8411904e69324169ad7f8907297f650c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:01.945414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:01.948245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b9f5-a536-4158-a183-34140038a0e2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:01.954503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 359/714] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/role_assignments?user.id=8411904e69324169ad7f8907297f650c&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:01.956103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:01.956601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:01.957087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:01.962308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:01.980954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:01.982549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:02.019368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:02.075148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 360/715] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:02.109835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:02.127625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1d9db-f79a-4474-b5b2-09bbba89397f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:02.212262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:02.213150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:02.213526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:02.213913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:02.217561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:02.218000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:02.219902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:02.229972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 356/716] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:02.238074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2bda9-492e-4e35-ae9f-d40fc1708a27 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:02.280286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:02.281114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:02.281393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:02.281668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:02.282379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:02.283937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:02.297387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:02.298511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:02.299349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 361/717] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:02 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:02.305639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:02.416337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:02.436293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d8c4b-0489-42a6-a14b-3fbd641a20af None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:02.480625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:02.481310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:02.481597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:02.481878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:02.482640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] RBAC: Adding query filter params (name=network) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:02.482950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:02.484318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d91eda-86ce-4d11-bb10-ca5b6fa7c139 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:02.489359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 357/718] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:02.495503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:02.524416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:02.604276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58082fa2-6086-4f78-b83c-6476520c5cff None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:02.648696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:02.649417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:02.649707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:02.650020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:02.650751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:02.651063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:02.652444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da9cd9-68f4-400f-b3d2-eef8190a7a2a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:02.663349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 362/719] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:04.424081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02f68-7754-40a7-8d12-a5a9e2d1f124 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:04.424594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02f68-7754-40a7-8d12-a5a9e2d1f124 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:04.424698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02f68-7754-40a7-8d12-a5a9e2d1f124 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:04.426322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 358/720] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:04.432508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:04.433410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:04.433946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:04.454396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:04.455958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:04.538652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe08eb-fde2-46c8-b548-0582d70163d5 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:04.539287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe08eb-fde2-46c8-b548-0582d70163d5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:04.539789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe08eb-fde2-46c8-b548-0582d70163d5 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:04.541378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 359/721] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:04.551935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:04.552230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:04.552512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:04.559766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 363/722] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:04.582183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:04.586905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:04.588119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:04.615729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:04.727449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 360/723] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:04.738802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaafd3b-f974-4cd4-a7e9-fcc95a2d2bfb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:04.774815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:04.775715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:04.776003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:04.776275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:04.777070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:04.786953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:04.795475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:04.796413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:04.797994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:04.800774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 364/724] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:04.802037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.026364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.031955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.036000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc758f-ddf4-4038-95ed-ce840c4043e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.062382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d064814-2fc7-4326-afa0-89338dcb209a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.075216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.075896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.076178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.076547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.077302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:05.077609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.079047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2b176-f9f7-4c81-b0d4-d413f0d5bf72 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.091262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 365/725] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:05.091262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccfd87-f001-430d-a681-c2788faef13d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.091262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccfd87-f001-430d-a681-c2788faef13d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.091262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccfd87-f001-430d-a681-c2788faef13d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.091262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 366/726] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:05.092813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7419c5-7e39-404c-a159-5984e61c0a37 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.092813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7419c5-7e39-404c-a159-5984e61c0a37 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.093003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7419c5-7e39-404c-a159-5984e61c0a37 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.098184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 367/727] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:05.098982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7419c5-7e39-404c-a159-5984e61c0a37 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.112515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.113323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.113613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.113917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.125503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c318558a-10bc-4f62-b35d-1ee9ba0bbd43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:05.133991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:05.140841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 361/728] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:05.141673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051efe-1108-46c5-8de1-66a2108386fe None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.142438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051efe-1108-46c5-8de1-66a2108386fe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.142438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0051efe-1108-46c5-8de1-66a2108386fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.156674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a0051efe-1108-46c5-8de1-66a2108386fe None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:05.158257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a0051efe-1108-46c5-8de1-66a2108386fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:05.212692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7419c5-7e39-404c-a159-5984e61c0a37 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.241925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 362/729] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:05.241925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.241925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.241925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.252774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:05.254052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:05.268894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.269967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.270343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.271096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.282331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.283700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.286212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:05.302777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:05.304411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 368/730] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:05.310058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.330808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.338507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 363/731] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:05.339625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.432613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d51719-4933-4b27-a5df-79f14beed6a8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.446575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efbc4-d85c-4be4-8235-31f8a58b7189 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.469029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.469528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.469818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.470126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.470884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:05.471230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.472617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.485285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 369/732] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:05.485285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.489074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.489830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.490260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.491063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.491797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.493176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.547492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.590046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23424e3-9edd-4add-b8da-b7d4be6d96b7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.592577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 364/733] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:05 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:05.593423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.640437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.641125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.641408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.641682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.642445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:05.642756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.644727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.658906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 370/734] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:05.660411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.668807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.717624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acf09-3d2c-4b02-b37e-2427a7e4d87f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.757198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.758042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.758523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.758846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.770179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:05.776512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65bc51-b3cb-4eed-b585-1b140f9131b1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b1059999-8359-48fd-8e48-aab304d4eb7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:05.778664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:05.779591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:05.780436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 365/735] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:05.781730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f6474-7f87-4e37-b232-d0d1ea932c4a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.781730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f6474-7f87-4e37-b232-d0d1ea932c4a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.781730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f6474-7f87-4e37-b232-d0d1ea932c4a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.783325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 366/736] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:05.783895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f6474-7f87-4e37-b232-d0d1ea932c4a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.803267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.826881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.827228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.827483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.827799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.839925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.842196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:05.861312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:05.862453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:05.863637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:05.863637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:05.863637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:05.863637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:05.865967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 371/737] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:05.866923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:05.909587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f6474-7f87-4e37-b232-d0d1ea932c4a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.932218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:05.950175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:05.950968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.951255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.951524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:05.959673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:05.961676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:05.976198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a845c-1ac7-4231-a1ee-fb1189131b7c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c923223f-4d39-4227-9c83-e645b8dd3785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:05.977067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:05.978072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:05.979223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:05.982751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 367/738] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:05.984001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:05.984281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:05.984553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.001428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:06.002647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:06.017460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.018378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.018804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.019242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.020139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.020445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.022378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.034663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 372/739] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.034663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.065381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.081343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 368/740] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 20:44:06.082616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.152888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f869e4-b77b-4a67-8c8b-cf7da591a4ba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.192073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.192853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.193140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.193987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.194712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.195278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.196392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.204294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ed7d-10f4-42dd-ad48-b5666ff9be16 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.208258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 373/741] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.208911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.218840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.246006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.247127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.247127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.247300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.248045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.248354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.249794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.268839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 369/742] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.269421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.305706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.321670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ba32-298c-4fb8-b10e-33f07f3efe5d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.359083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.360018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.360296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.360596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.372745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.374222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.381963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55ed59-ea5b-4231-9488-da6b593ccb27 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:06.393126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:06.394094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:06.394972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:06.394972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:06.394972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:06.394972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:06.394972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 374/743] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:06.395256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.423601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.424277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.424560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.424839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.425565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.426963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.497063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8bafb-c541-4818-83bc-2aa36746bfd7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.513947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 370/744] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:06 2022] POST /identity/v3/services => generated 240 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:06.515850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.544809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.546662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.547420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.548426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.552129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.562226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.564197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.578479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:06.586096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:06.587101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:06.588063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:06.595141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 375/745] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:06.595141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.651331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974545b-fbf9-49b0-8075-5575c325ba5c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.691957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.693306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.694297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.694742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.707755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.709148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60441cf-9004-4e26-9455-14f25d4b997d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.709944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:06.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:06.731641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:06.732574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:06.732574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:06.732574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:06.732574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:06.732574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 371/746] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:06.733391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.758741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.759408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.759685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.759959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.763085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.763085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.763085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.776649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 376/747] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.777543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.832869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.844449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:06.859231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deba23a-9381-413a-9cbd-05af2e163041 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.891888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344de8-f34a-401b-9b1f-3aea56fb0802 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:06.896150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.896867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.897154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.897433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.898418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.898735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.900312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.920370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 372/748] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.921237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:06.936331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:06.937029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:06.937320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:06.937591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:06.938363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:06.938677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:06.940064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:06.953121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 377/749] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:06.954035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.062102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362da16-a002-4e50-9646-893e1dd6c03a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.065990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5940e2-7ce3-4b63-ad01-2f408b88706e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.083284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.103713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.104664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.105052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.105643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.110451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.111362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.111943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.112366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.113720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.116215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:07.132885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:07.133939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:07.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:07.138204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.139208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 373/750] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:07.140137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.190222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.192015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.244161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbe67e-e72b-4ef7-8738-84c1f543e258 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.279914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.280819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.281175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.281523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.289368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.291078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.303802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 378/751] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:07.304960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:07.305558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:07.306624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:07.307524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 374/752] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:07.308028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.324690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.368292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.415564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a47ca9-008d-41b9-8d7b-5a392b408306 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.421075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b29752-8be2-4941-b54a-ff594c5f91ac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.450774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.451732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.452112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.452387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.460262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.461226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.461687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.462202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.463309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:07.463852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.464541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.465733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.466038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:07.484392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:07.485359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 375/753] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:07.486673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.489247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 379/754] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:07.495104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.572990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.596903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb27826-2859-43f9-98ff-0c9ea71bf374 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.605436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.613813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb7a3a-6451-4f29-a300-eb41e4161101 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.636715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.637343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.637628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.637926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.638743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:07.639048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.640469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.653935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 376/755] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:07.654839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.656248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.657165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.657834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.658621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.734244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.736234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.760809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e48c05-3872-4c74-9b06-8eb37ae9eacf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.799897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.800768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.801201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.801626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.802672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:07.803134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.804647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.814347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.817627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 377/756] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:07.819534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.849059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:07.854959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 380/757] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:07.854959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:07.932224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756f77-0900-428b-89bd-b1301c4d2f97 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.960396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf276-3e1d-41d2-a08c-556c36bce6e0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:07.969300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.969955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.970242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.970517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:07.972473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=0ac9c94438bf4a0b8a603d472ca317f2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:07.974152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db72cf-cf0d-42fa-a5e6-62844b72ed96 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:07.997369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:07.998179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:07.998461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:07.998736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.005301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.007322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:08.020918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:08.021964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:08.022853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 381/758] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:08.023851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 378/759] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:07 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737628-b908-4828-a50a-58bd6f409d92 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737628-b908-4828-a50a-58bd6f409d92 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23737628-b908-4828-a50a-58bd6f409d92 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 379/760] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:08.055131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23737628-b908-4828-a50a-58bd6f409d92 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.067753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.159253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6fd7-68bf-4ad1-9331-b1ce4c380e9c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.173245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.192153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23737628-b908-4828-a50a-58bd6f409d92 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.208769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.209615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.210077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.210412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.225804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.228006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.234994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.235960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.236395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.238458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.239621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:08.240623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.242361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-88209621-7978-487e-a320-8f52ecd5e766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:08.252893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:08.254109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:08.255191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:08.255191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:08.255191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:08.255191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:08.258336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 382/761] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:08.260739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.261049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.261327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.268162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 380/762] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:08.270138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.287979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:08.289558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:08.369461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 383/763] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:08.370385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.397116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.398537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2718f-298e-42a0-be18-ddb9d2c768c7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.438292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.438981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.439262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.439535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.440271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:08.440580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.441977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.455587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 381/764] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:08.456343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.465441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.503704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18590c03-3046-4771-baa7-153678b9cf6c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.540818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.541469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.541800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.542138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.542969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=76746e56fdda493f8e64e66c03fedcd2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:08.543283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.544843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.557930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 384/765] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/role_assignments?user.id=76746e56fdda493f8e64e66c03fedcd2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:08.557930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.580371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7d9b-9c21-4e78-816a-272923f44c10 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.647272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.648928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.649416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.649912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.650828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.652411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.674332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:08.676512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:08.677419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:08.678713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 382/766] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:08.680504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc51cb-de75-41df-8fef-176f89dc0665 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.683958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.718184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.719068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.719422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.719816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.728561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.730169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:08.745655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:08.746617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:08.747806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 385/767] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:08.753025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.825863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.866287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ecf4e-4983-48e3-a59b-c60c4a6d4bfa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.882259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acadb3b-8633-4467-9b72-f958449c320e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:08.904144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.904959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.905319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.905673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.906585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:08.906973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.908535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deb13-4e27-4b4e-be5c-8e01135cba6f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.918311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:08.923974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 386/768] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:08.927683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cefc-1b12-4de2-888d-e43ac8cf8b5b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.928060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cefc-1b12-4de2-888d-e43ac8cf8b5b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.928410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cefc-1b12-4de2-888d-e43ac8cf8b5b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.929885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 387/769] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:08.930774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cefc-1b12-4de2-888d-e43ac8cf8b5b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:08.957160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:08.958496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.959560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.959933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.960845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:08.961164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:08.963414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e22323-8de9-4693-ac27-7a33206f3d14 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:08.970541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 383/770] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:08.971941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:08.972235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:08.972519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:08.993252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:08.994866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:09.061180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cefc-1b12-4de2-888d-e43ac8cf8b5b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.070899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 384/771] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:09.071777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.105859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.106813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.107097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.107375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.108216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=8411904e69324169ad7f8907297f650c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.108787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.110991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.121991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 388/772] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:08 2022] GET /identity/v3/role_assignments?user.id=8411904e69324169ad7f8907297f650c&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:09.123755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.142025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:09.214356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:09.249238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70a657-c3da-48f0-af2a-f17087ef6f5d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.272474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622e69e-178f-4dd4-b979-cff580c33d3c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.293725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.294575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.294854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.295122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.295787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.297171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:09.326471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:09.327531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:09.328357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:09.330354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 389/773] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:09.344516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.361436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.362149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.362435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.362706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.363438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.363744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.365256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.379226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 385/774] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:09.385562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.495821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13e7fa-3043-472a-9bcc-3185c46b0d18 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.530469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:09.538895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.540097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.540379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.540656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.541457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] RBAC: Adding query filter params (interface=public, service_id=9b0f5c47df3541e99c91edf0f11413d9, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.541768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.543163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.555370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf970-e0d3-469e-bda3-5256a2598510 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.569186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 386/775] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/endpoints?service_id=9b0f5c47df3541e99c91edf0f11413d9&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:09.574621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.598691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:09.608292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.608960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.609245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.609569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.613547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] RBAC: Adding query filter params (name=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.613547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.613547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.617749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 390/776] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:09.623488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.730541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835f14-501d-4188-ba79-b76fc4a1f501 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.746289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b63b-f4e4-45bd-9463-6c87197c1b84 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.767864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.768536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.768816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.769089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.769803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.770136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.771533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.777167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 391/777] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:09.794518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:09.799266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.800015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.800305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.800675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.801418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.803473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.817211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 387/778] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:09.857075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:09.907125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5563-4790-4d45-a73c-da2e992bd188 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:09.943979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:09.944654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:09.944933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:09.945204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:09.946037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] RBAC: Adding query filter params (interface=public, service_id=006489a3d5974dd4a9a0d24bd3ac48dc, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:09.946353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:09.947747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c270-b938-4217-9f07-d49ff5fa1681 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:09.956825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 392/779] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/endpoints?service_id=006489a3d5974dd4a9a0d24bd3ac48dc&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:09.962413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:10.044303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:10.095879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c3c94-f9db-4df2-8441-14f3f8434a73 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:10.133813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:10.134576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:10.134862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:10.135139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:10.135828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:10.137201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284e9d-61fc-4810-8c52-ee54b2701139 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:10.143180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 388/780] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:09 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:10.651061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4b76-a221-43c3-830b-20ab03e703d2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:10.651347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4b76-a221-43c3-830b-20ab03e703d2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:10.651627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b4b76-a221-43c3-830b-20ab03e703d2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:10.653254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 393/781] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:10.658638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:10.658929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:10.659207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:10.678936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:10.680154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:10.756662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 389/782] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:10.793792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b4b76-a221-43c3-830b-20ab03e703d2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:10.954595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b4b76-a221-43c3-830b-20ab03e703d2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:10.979016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:10.997699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:10.998820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:10.999285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:10.999742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.011662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:11.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:11.020672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:11.021583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:11.023944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 394/783] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:11.029863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:11.081055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:11.136055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3c258-55a9-4385-9ee8-6a82eb2da206 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:11.194657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:11.195356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.195640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.195918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.196686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:11.196998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:11.198414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:11.208015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 390/784] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:11.213937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:11.378675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3375c-f7fd-4a0a-83c2-4e98129a82fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:11.432589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:11.433401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.433681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.433985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.447234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:11.448699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0b4b2dc3-a092-4263-b9f5-f6e206f74eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:11.476230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:11.477185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:11.478131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:11.478131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:11.478131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:11.478131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:11.478131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 395/785] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:11.487103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:11.674977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033c7a-1bd8-4f90-bcff-3b47efdd127e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:11.696893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618d56-5c1b-448e-9d14-c589a1b54a4d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.697205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618d56-5c1b-448e-9d14-c589a1b54a4d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.697444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1618d56-5c1b-448e-9d14-c589a1b54a4d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.698828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 396/786] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:11.702002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:11.706694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbc9c-1d8f-493c-b6ad-db556ed3fb39 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.707417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbc9c-1d8f-493c-b6ad-db556ed3fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.708203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbc9c-1d8f-493c-b6ad-db556ed3fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.733091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:11.733687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.733987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.734260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.734986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:11.735289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:11.736644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:11.750758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-66dcbc9c-1d8f-493c-b6ad-db556ed3fb39 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:11.752418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66dcbc9c-1d8f-493c-b6ad-db556ed3fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:11.761276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 391/787] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:11.766618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:11.780148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:11.871067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 397/788] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:11.887099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478fad-82bf-44a5-ac4b-f4d00c85b2a8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.887611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478fad-82bf-44a5-ac4b-f4d00c85b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.888069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48478fad-82bf-44a5-ac4b-f4d00c85b2a8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.889574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 398/789] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:11.895162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.895655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.896604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.917016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:11.918334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:11.940198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6916b2-45ff-4ad2-a2e9-a86fe473806b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:11.977248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:11.978399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:11.978831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:11.979252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:11.987515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:11.989162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:11.998338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 399/790] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:11.999359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:12.014342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.015486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:12.016645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:12.019034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 392/791] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:44:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:12.024692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.059357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.106718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.117905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250bc71-9413-4b06-a752-026c1652b568 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.132479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd401-b8f2-4f86-a5d3-29908087358b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.154783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.155658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.156044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.156532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.168540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:12.168838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.169689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.170214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.170678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.171693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:12.172157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.173710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:12.178024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.178999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:12.179845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:12.184396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 400/792] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:44:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:12.185313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.201305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 393/793] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:12.202867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.296335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e505-14af-4b08-a07c-0c021f5a5f68 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.311200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.322304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eba3e-8ea3-4722-9fdf-0d51a4e4afd0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.336937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.337740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.338072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.338353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.349658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:12.357686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.358723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:12.359649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:12.361963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 401/794] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:12.363055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.366645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.367337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.367621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.367898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.369162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:12.369475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.371867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.383527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.386038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 394/795] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:12.388277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.475290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162755e-5748-4c65-a288-b7651fe8e5c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.500093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236441-29dc-44fd-a9aa-a0ab29ab4394 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.512071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.512859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.513190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.513537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.539028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.540067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.540531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.540999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.541968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:12.542479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.544124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.553453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 395/796] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:12.554764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.603382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.605299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.666424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb60e8-1654-42c3-bb06-3c54a86ace54 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.675857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.703768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.704966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.705269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.705548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.706439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.717335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.718814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.723835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 402/797] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:12.723835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-072be2d6-d1b8-42d6-822d-7451a5f7cf8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:12.737548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.744048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 396/798] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ccc6-997b-4751-bc9d-aee25cffd888 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.744946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ccc6-997b-4751-bc9d-aee25cffd888 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.745562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ccc6-997b-4751-bc9d-aee25cffd888 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.747074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 397/799] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:12.747957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66ccc6-997b-4751-bc9d-aee25cffd888 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.840350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.843130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906d99-6aff-4d04-ad42-84fd2fd4d161 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.854626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:12.879775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66ccc6-997b-4751-bc9d-aee25cffd888 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:12.882124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.882932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.883218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.883493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.893798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.895295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:12.913668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.914815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.915788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:12.915788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:12.915788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.915788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:12.918980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:12.919671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 403/800] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:12.919854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.920128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.920275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:12.920433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.933725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:12.935216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-117574a5-c2a5-47bf-a169-ecb41ae1cfdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:12.954125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:12.955066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:12.955962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:12.955962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:12.955962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:12.955962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:12.955962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 398/801] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:12.956874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:12.957160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:12.957441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:12.974815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:12.976018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:13.030693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faa7f-b8b2-4c60-b2d7-b55f070dbdf9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.044923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 399/802] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:13.046093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.067381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.068706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.068983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.069263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.070023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.070327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.071722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.083193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 404/803] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.084572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.097344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.108355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.149510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582d67a-0171-4b2d-9d3a-3ebec869b1f8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.183061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b55f5-9c54-4284-b4a4-e25efc78d81c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.183254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.183914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.184198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.184474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.185212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.185508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.186957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cccd-c81a-422c-a97e-08995320c9ab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.198601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 400/804] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.199860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46bbda-f1b1-4a62-8b23-e9273d67ec65 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.200152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46bbda-f1b1-4a62-8b23-e9273d67ec65 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.200437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46bbda-f1b1-4a62-8b23-e9273d67ec65 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.201934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 401/805] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:13.202496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46bbda-f1b1-4a62-8b23-e9273d67ec65 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.217448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.218145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.218432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.218712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.219437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.219747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.221120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.232450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 405/806] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.233084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.304978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46bbda-f1b1-4a62-8b23-e9273d67ec65 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.313810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.314157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.331999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c873e4-f6a0-4bfe-b83a-12c51c0db42f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.338698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.339515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.339795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.340067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.340712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.342111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:13.354070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:13.355100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.355958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 402/807] 10.222.0.55 () {56 vars in 1129 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:13.356822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.370252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.372321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.372321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.372321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.378613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.380124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-389c236e-d496-49cf-be58-1c454d2f934e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:13.395253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:13.396310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:13.397258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 406/808] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:13.397876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.398053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.398319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.414832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:13.416020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:13.459091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1566-1285-4828-821b-c7ab3579568a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.482288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 407/809] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:13.483050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.504173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.505852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.506186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.506462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.514370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.515802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:13.529690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:13.530877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 403/810] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:13.531846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.556413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.563393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.585136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2ad8-c323-42d8-b512-1cdc3de15843 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.621098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.621820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.622138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.622419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.629741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.631253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.631371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fe97-07a4-4eb1-9c24-436273f4d17f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:13.644835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:13.646003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 408/811] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:13.647000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.669176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.669843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.670160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.670439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.671149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.671464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.672825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.677831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 404/812] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.678760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.747345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770cab6-8ced-440d-a605-66b60373bfda None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.774199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.776388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:13.779989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b659-19c1-4ca6-8471-d6f850a1b7ac None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.780948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.781618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.781919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.782204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.783102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.783415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.784841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.803152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 409/813] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.803995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.818099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.818907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.823078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.823078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] PATH_INFO: `/v3/services/network` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.823078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.823078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:13.833276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:13.834389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:13.835212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 405/814] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:13.835990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.909068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a102e-3359-40ad-9701-7b1677c498a1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.934303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120d4da-183a-4028-94fa-84b9dae73d22 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:13.942963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.943633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.943918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.944192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.945162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.945747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.947217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.965660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 410/815] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.966316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:13.971628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:13.972300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:13.972586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:13.972863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:13.973658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:13.974054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:13.975994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:13.990165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 406/816] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:13.990997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.012357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.021169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.069697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535199-4997-423f-b429-dfe317f2113c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.087688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fa7e5-3b2b-48ae-9d6f-42b2665e614a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.102366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.103038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.103350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.103630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.104340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.104693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.106106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.110960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 411/817] 10.222.0.55 () {56 vars in 1124 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.111751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.121989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.122779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.123059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.123331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.133854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.135319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:14.152330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:14.153222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:14.154142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:14.154142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:14.154142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:14.154142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:14.154142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 407/818] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:14.155740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.213688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93381-3179-476b-a22a-e2b01246183c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.225040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.227220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.248180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.248852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.249139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.249418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.250156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.250463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.251899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.253576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200eb01e-1828-4059-baaa-88a7d5618938 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.256937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 412/819] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.257717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.289361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.290275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.290604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.290882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.300892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.302910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:14.320151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:14.321185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:14.322131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:14.322131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:14.322131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:14.322131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:14.325977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 408/820] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:14.328635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.366873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648834c-6a3c-45e3-86c1-381effdec6f7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.400547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.401213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.401594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.401872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.402743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.403057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.404606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.410715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 413/821] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.412152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.431520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6de-ad91-457f-bf3e-315bcc1ac864 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.460297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.462818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.476693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.476693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.476693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.476693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.477144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.477144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.533179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086cc6f-c6d4-4266-ae1c-234ad2c50523 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.569271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968152-f11c-4345-8790-a084eca638df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.569967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968152-f11c-4345-8790-a084eca638df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.570251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968152-f11c-4345-8790-a084eca638df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.570524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968152-f11c-4345-8790-a084eca638df None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.571257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968152-f11c-4345-8790-a084eca638df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.571563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968152-f11c-4345-8790-a084eca638df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.572954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968152-f11c-4345-8790-a084eca638df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.585906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 414/822] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.586798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968152-f11c-4345-8790-a084eca638df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.608538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 409/823] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:14.609433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.710889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.717145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968152-f11c-4345-8790-a084eca638df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.769210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802294d8-2aaa-444d-a682-49aece587ea0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.771309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.773283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.773838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.774288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.775188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.775651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.777343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.785830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 415/824] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.787653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.815510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.816561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.817109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.817586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.818475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:14.818851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.820333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.836413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 410/825] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:14.838256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:14.883325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:14.916753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f583-4cd9-48a1-9911-555b8821d35c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.961673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:14.962861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:14.963141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:14.963570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:14.970540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a37d-591d-4735-a100-de1001049ab2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:14.972544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:14.975497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:14.992512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:14.993924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:14.995011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:14.997118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 416/826] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:14.998172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:15.011485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.012367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.012573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.012833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.013585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.015015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.024458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:15.113925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 411/827] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:15.113925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:15.116960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ad48-401c-4887-82bc-5947675ce5b7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:15.200048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.202560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.202838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.203110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.216231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.217705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:15.245515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:15.246519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:15.247394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:15.253006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 417/828] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:15.257826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:15.304922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:15.320074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f5b5a-f084-440f-8ccf-92bf991a45ff None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:15.379379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.381132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.381601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.382334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.383334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:15.384028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.386330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.405838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 412/829] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:15.407155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:15.411629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:15.437465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba587-0a44-4eba-9d32-cddd8e98154d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:15.476022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.477045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.477601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.478201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.479255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:15.479763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.481703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.496939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 418/830] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:15.503081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:15.524794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b972-e74b-4828-81d3-43c82b40eb4e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:15.560517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.561331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.561910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.562227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/76746e56fdda493f8e64e66c03fedcd2/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.579444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=76746e56fdda493f8e64e66c03fedcd2, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.580896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58686551-08c3-4c00-b988-c59b6218c4b1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.624493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76095-930d-4c08-9c41-f050d7ecb2a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:15.660883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:15.661848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:15.662143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:15.662700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/8411904e69324169ad7f8907297f650c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:15.664752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=8411904e69324169ad7f8907297f650c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:15.666200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16745bb6-4375-4e2e-bbab-c577fafe1385 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:15.669638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:15.681288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 413/831] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:15 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/76746e56fdda493f8e64e66c03fedcd2/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:44:15.806151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 419/832] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:15 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/8411904e69324169ad7f8907297f650c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:44:16.897029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504d82-5aee-4d17-be17-1783d7d9c931 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:16.898022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504d82-5aee-4d17-be17-1783d7d9c931 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:16.898523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504d82-5aee-4d17-be17-1783d7d9c931 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:16.900339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 414/833] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:16.905974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca18c7-dfa3-4e3d-845b-d00e1010cd5d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:16.906799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca18c7-dfa3-4e3d-845b-d00e1010cd5d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:16.907277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca18c7-dfa3-4e3d-845b-d00e1010cd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:16.925302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2eca18c7-dfa3-4e3d-845b-d00e1010cd5d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:16.927443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2eca18c7-dfa3-4e3d-845b-d00e1010cd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:16.999572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 420/834] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:17.022268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6504d82-5aee-4d17-be17-1783d7d9c931 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.025454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:17.050025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525554a8-99bf-42df-8535-06b0ee1f159b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.050214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525554a8-99bf-42df-8535-06b0ee1f159b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.050488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525554a8-99bf-42df-8535-06b0ee1f159b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.052524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 421/835] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:17.057836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.058136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.058407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.078808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:17.086284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:17.146027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6504d82-5aee-4d17-be17-1783d7d9c931 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.166949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 422/836] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:17.190755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.193644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.195708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.196191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.196681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.197525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.199219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:17.215656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:17.216584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:17.217411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:17.219435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 415/837] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:17.226166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.267090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:17.307325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:17.317397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ab1e-2c18-4f98-89ee-4687f5369b57 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.353733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d5ffd-6287-4ace-8ef8-64365f4537b3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.358272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.359155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.359511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.359857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.360594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.362084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:17.375854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:17.376869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:17.377696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:17.382377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 423/838] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:17.383844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.397200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.398510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.398978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.399696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.400608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:17.401262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.403505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.414647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 416/839] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:17.416204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.507453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88caeb-3243-4f72-94b3-fa3e9c76d91b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.532600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:17.538105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cf2ab-2500-4e24-9ece-40127a2b73ed None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.551197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.552554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.552937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.553564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.554912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:17.555329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.557066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.568161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 424/840] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:17.571083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:17.574761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:17.581704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.582437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.582733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.582994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.583739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:17.584044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.586142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a279e57-ebe0-4a78-a0c9-e6c9edf9214d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.594020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 417/841] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:17.699102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d209-8d38-4cc7-adb9-a91862be38c5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:17.742120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:17.743069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:17.743352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:17.743627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:17.744350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:17.744657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:17.746078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633af5-7883-46cd-8235-b6380de23d26 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:17.752064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 425/842] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:18.013156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f48-0e5c-4e37-8773-d6865d6719b1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.013678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f48-0e5c-4e37-8773-d6865d6719b1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.013678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24670f48-0e5c-4e37-8773-d6865d6719b1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.015338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 418/843] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:18.021462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59882b4-733e-47c2-b7b2-3f0d36c610f7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.021967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59882b4-733e-47c2-b7b2-3f0d36c610f7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.022074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59882b4-733e-47c2-b7b2-3f0d36c610f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.039683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d59882b4-733e-47c2-b7b2-3f0d36c610f7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:18.040868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d59882b4-733e-47c2-b7b2-3f0d36c610f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:18.087734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.111773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 426/844] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:18.137099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24670f48-0e5c-4e37-8773-d6865d6719b1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.159414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf5e3-997e-461d-8bf1-c4a1f5cbbfd4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.159728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf5e3-997e-461d-8bf1-c4a1f5cbbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.159969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bf5e3-997e-461d-8bf1-c4a1f5cbbfd4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.161603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 427/845] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:18.166901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.167211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.167535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.184825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:18.186046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:18.251549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24670f48-0e5c-4e37-8773-d6865d6719b1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.257580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 428/846] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:18.282105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.288957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.289781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.290106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.290386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.301751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:18.309606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:18.310732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:18.311735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 419/847] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:18.322955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.394316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.400027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82241a-5e2c-463a-ad4f-04780faf21df None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.410325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.438348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.439578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.440076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.440509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.443459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e731-e322-4055-907c-fd169a2bb4cd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.452722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:18.461341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:18.462469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:18.463501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:18.466148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 429/848] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:18.471726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.489866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279538-3392-402d-9bde-a01152128356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.490866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279538-3392-402d-9bde-a01152128356 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.491442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279538-3392-402d-9bde-a01152128356 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.491874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279538-3392-402d-9bde-a01152128356 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.493660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7279538-3392-402d-9bde-a01152128356 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:18.494146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7279538-3392-402d-9bde-a01152128356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:18.496128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7279538-3392-402d-9bde-a01152128356 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:18.508053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 420/849] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:18.513810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279538-3392-402d-9bde-a01152128356 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.606656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d4b5-6131-4885-a50f-702a35eff95d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.649529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279538-3392-402d-9bde-a01152128356 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.653953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.654887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.655374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.655849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.656901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:18.657433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:18.659249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:18.666295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.670029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 430/850] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:18.675656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.690552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.692286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.693619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.694105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.707618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:18.709409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:18.710929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:18.729453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:18.730655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:18.731551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:18.731551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:18.731551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:18.731551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:18.738165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 421/851] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:18.739927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.785284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdded7-e80d-4f0d-a5fc-8a4d654b568b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.823847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.825130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.825130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.825607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.837201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:18.839047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:18.858440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:18.859397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:18.860363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:18.860363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:18.860363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:18.860363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:18.861915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15ff71-a7db-4744-817f-77a2c25aef5d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:18.865072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 431/852] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:18.866335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.901138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:18.902334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:18.902826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:18.903358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:18.904347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:18.904880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:18.906539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:18.927757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 422/853] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:18.929265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:18.956472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.962138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:18.975954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc22f9-f1f1-417b-9c72-6a785fbda9e5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.013239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.013999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.014364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.014653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.015445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:19.015845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.017303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.029740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 432/854] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:19.035304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.047549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19e09f-7a83-4fe3-bd89-ca418f4212dc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.086158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.087434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.087989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.088487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.097159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.099555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:19.116865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:19.118092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:19.119065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:19.126523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 423/855] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:19.127638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.141166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2245-a931-45d4-a2c4-daae2d3b43b7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.176757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.177633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.177841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.178152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.186872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.188353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:19.202949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:19.203922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 20:44:19.204959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:19.209750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 433/856] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:19.210650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.213700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.233413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.248460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de499-5666-4fb7-b2f0-358df644ae45 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.287616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.288673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.289160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.289637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.290884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:19.291425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.293232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.317505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9710b-d6d3-4c02-a3f9-c6ffc99689f7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.318087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 424/857] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:19.319378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.353170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c795-9178-4201-b184-53621c119905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.353931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c795-9178-4201-b184-53621c119905 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.354251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c795-9178-4201-b184-53621c119905 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.354536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c795-9178-4201-b184-53621c119905 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.355391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c795-9178-4201-b184-53621c119905 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:19.355706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c795-9178-4201-b184-53621c119905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.357216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c795-9178-4201-b184-53621c119905 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.381069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 434/858] 10.222.0.55 () {56 vars in 1135 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:19.382096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c795-9178-4201-b184-53621c119905 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.434368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e6403-5db2-49e3-a2a7-665271559415 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.444735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.475912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.476993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.477484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.478005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.487866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c795-9178-4201-b184-53621c119905 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.496945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.525366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.526386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.526386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.526673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.561247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.563335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.599272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.600817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.668658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.686599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 425/859] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:19.687911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.717691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 435/860] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:44:19.718832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.743052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.809793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7abbc-57e8-4da0-9baf-d49f57d1c9d5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.827138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12275-e445-4fa9-8ab1-66f2fb8794fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:19.848658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.849648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.850037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.850460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.863312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.863475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:19.864261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:19.864554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:19.864835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:19.865129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.875666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:19.877125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:19.885064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:19.886005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:19.886947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:19.886947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:19.886947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:19.886947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:19.891144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 426/861] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:19.892068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:19.896829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:19.898886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:19.900998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:19.900998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:19.900998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:19.900998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:19.906134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 436/862] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:19.907010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:19.923708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:19.999226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.003347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b02dad-f02f-45ea-bbc8-391cdec0930f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.018507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5405-a019-4fe1-a424-d4d666fd0a8b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.040515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.041305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.041708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.042017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.042754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.043064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.044716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc3183-3899-4130-a67c-09bd29c97481 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.052251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.052924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.053201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.053475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.054223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.054525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.055890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219dc91-0711-430a-980c-5261db46e455 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.059641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 427/863] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:20.061527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a24-3a2c-412a-ab38-fa9a20668079 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.062020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a24-3a2c-412a-ab38-fa9a20668079 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.062537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a24-3a2c-412a-ab38-fa9a20668079 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.065955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 428/864] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:20.065955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891a24-3a2c-412a-ab38-fa9a20668079 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.073826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 437/865] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:20.075010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.075298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.075576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.092730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:20.093943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:20.161680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 438/866] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:20.162550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.164670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.192064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891a24-3a2c-412a-ab38-fa9a20668079 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.226638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.227430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.227713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.227988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.234513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.235937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0690e01d-0f59-4d48-b8e5-c2703aaeaeb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:20.251053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:20.252110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 429/867] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854edc-42cf-40aa-a543-32865c7d98f7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.258503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854edc-42cf-40aa-a543-32865c7d98f7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.259228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71854edc-42cf-40aa-a543-32865c7d98f7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.259228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 430/868] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:20.259228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854edc-42cf-40aa-a543-32865c7d98f7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.269991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe5185-7219-4ec8-b662-110cd026f659 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.277123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.304761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.305559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.305843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.306149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.312871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.314363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:20.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:20.329528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:20.330457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 439/869] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:20.330945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.365988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71854edc-42cf-40aa-a543-32865c7d98f7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.391873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.400604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.401266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.404025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.404025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.404025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.404025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.430514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb8c78-ffef-48a2-852d-284d8b583f55 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.465635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.466255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.466540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.466818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.467603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.467913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.469340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17590de2-9b78-471b-bb00-11fcc548dbca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.481116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 440/870] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:20.482589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.482880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.483160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.498771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:20.499949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:20.559731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 431/871] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:20 2022] POST /identity/v3/services => generated 269 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:20.560610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.573737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 441/872] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:20 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:20.575780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.646809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.652720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.678252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498adbb8-fdb0-48f9-8c86-da345b3d37de None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.713752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1d73-9249-440e-bb31-24a012c2003d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.720431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.720431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.720431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.720431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.720836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.720836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.720836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.735328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 432/873] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:20.736192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.760501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.761935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.761935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.761935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.762643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=76746e56fdda493f8e64e66c03fedcd2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.762961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.764404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.771971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 442/874] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/role_assignments?user.id=76746e56fdda493f8e64e66c03fedcd2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:20.772824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:20.878425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7f6fc-96bd-4b68-bc49-4412e4807f9c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.900566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2eb88-cd2a-4bb1-b130-34f690ad026b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:20.916267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:20.925185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.925922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.926237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.933755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.933755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.933755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25489-6164-4c4b-bf2c-5849b14375ec None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.944109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:20.944786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:20.945114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:20.945397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:20.946271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=8411904e69324169ad7f8907297f650c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:20.946584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:20.948063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c2d96-eb36-4053-9125-3964dabee058 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:20.954984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 443/875] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:20 2022] GET /identity/v3/role_assignments?user.id=8411904e69324169ad7f8907297f650c&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:21.058368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:21.065323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 433/876] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:20 2022] POST /identity/v3/services => generated 251 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:22.959640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2217-8c28-4fe7-b666-7290671d3844 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:22.960187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2217-8c28-4fe7-b666-7290671d3844 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:22.960187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a2217-8c28-4fe7-b666-7290671d3844 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:22.961866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 444/877] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:22.967657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df40-b7d0-4391-8b38-7d2bb694ae74 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:22.968127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df40-b7d0-4391-8b38-7d2bb694ae74 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:22.968229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df40-b7d0-4391-8b38-7d2bb694ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:22.987536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-db63df40-b7d0-4391-8b38-7d2bb694ae74 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:22.988810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-db63df40-b7d0-4391-8b38-7d2bb694ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:23.078100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 434/878] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:23.095200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a2217-8c28-4fe7-b666-7290671d3844 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.203466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a2217-8c28-4fe7-b666-7290671d3844 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.232013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc1c8-093b-4b02-8324-0148c6d71e12 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.232384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc1c8-093b-4b02-8324-0148c6d71e12 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.232533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc1c8-093b-4b02-8324-0148c6d71e12 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.235237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 435/879] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:23.239416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abf4b-3ac1-4ea9-b295-0463efb49f87 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.239712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abf4b-3ac1-4ea9-b295-0463efb49f87 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.239999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abf4b-3ac1-4ea9-b295-0463efb49f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.245868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.246975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.247483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.247977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.248838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.250471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.258291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ae7abf4b-3ac1-4ea9-b295-0463efb49f87 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:23.259491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ae7abf4b-3ac1-4ea9-b295-0463efb49f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:23.264155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:23.265089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:23.265956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.268912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 445/880] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:23.275472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.334422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.349781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 436/881] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:23.351178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb854aff-fe30-4c42-a2ac-802c4b10222a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.351475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb854aff-fe30-4c42-a2ac-802c4b10222a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.352407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb854aff-fe30-4c42-a2ac-802c4b10222a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.353124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 437/882] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:23.354213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066e75-fd96-49d9-9280-06d061398ac0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.354496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066e75-fd96-49d9-9280-06d061398ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.354822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066e75-fd96-49d9-9280-06d061398ac0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.357741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 438/883] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:23.359074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.359360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.359637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.377119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:23.378338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:23.398129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c75033-1bf7-450c-b43d-1d954dcf236b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.427727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.432246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.432921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.433203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.433484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.434239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:23.434545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.439356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d4a9-b96e-4839-bc6d-96d9938339b9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.440718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 446/884] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:23.441954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.442257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.442542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.448745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 439/885] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:23.449561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.458861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:23.460040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:23.526514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 447/886] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:23.527357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.550255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc75d-f2d8-47f4-8f0f-4451ef868ebd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.561862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.584566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.585350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.585659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.586016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.596107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:23.604708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:23.605849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:23.607099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 440/887] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:23.609093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.632240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d25c3-0694-4a4f-afe8-7da1ecee3242 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.657393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.666592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.667309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.667592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.667872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.668581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:23.668886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.670303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.675214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 448/888] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:23.676093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.713615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548760da-ed7a-4d84-aeb1-7eab9162e9d3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.747866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.748676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.748963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.749242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.749925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.751305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:23.763462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:23.764524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:23.765524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 441/889] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:23.766606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.774136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.777815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c4f9-51c1-4306-819b-2faecd404323 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.813160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.813997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.814287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.814570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.815238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.816692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:23.828537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:23.829506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:23.830367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 449/890] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:23.831167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.880424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33ef6f-24a7-4440-b9a5-f34499d18242 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.889346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:23.914460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da982489-7f51-4631-9f12-52199d704305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.915136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da982489-7f51-4631-9f12-52199d704305 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.915418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da982489-7f51-4631-9f12-52199d704305 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.915698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da982489-7f51-4631-9f12-52199d704305 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.916455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da982489-7f51-4631-9f12-52199d704305 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:23.916763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da982489-7f51-4631-9f12-52199d704305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.918170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da982489-7f51-4631-9f12-52199d704305 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.926926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 442/891] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:23.927721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da982489-7f51-4631-9f12-52199d704305 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:23.934725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995c36-c6d9-47ba-ab73-d662796bde4b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:23.968550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:23.969212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:23.969487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:23.969764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:23.970596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] RBAC: Adding query filter params (interface=public, service_id=72ea85d8437c4aacadfae637652de231, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:23.970911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:23.972277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:23.978100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 450/892] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/endpoints?service_id=72ea85d8437c4aacadfae637652de231&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:23.978721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.006848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.029966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da982489-7f51-4631-9f12-52199d704305 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.064810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.065480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.065765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.066089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.066810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.067671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.069012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.073678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 443/893] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.074487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.083180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07337e-c7ea-4ee4-93df-05307d399a9f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.109432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.116156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.116833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.117120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.117701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.118461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.124001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.124001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.124768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 451/894] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.125558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.184828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5287-6cd4-44f0-aa8c-0ec2249729ef None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.216119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.226158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d5c1-43c8-4d79-9800-f7ff47d44ce2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.226589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.227370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.227654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.227924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.238079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.239488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:24.257909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:24.258845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:24.259708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:24.259708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:24.259708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:24.259708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:24.260999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.261671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.261993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.262275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.262964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.263608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 444/895] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:24.264324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.264599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.278779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 452/896] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:44:24.279779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.378579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.396590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7f956-bc03-40a9-b8bb-c568a634616c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.397002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413952-1136-44ac-9e04-d06a8fe7849a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.434674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.435112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.435354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.435634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.435733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.435907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.436016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.436264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.436622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.436985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.437084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.437315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.438348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.438740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.453858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 445/897] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.453858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.454197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 453/898] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.454197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.475521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.575774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1de1fa-16e4-431d-b4b8-0e08297dc163 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.580407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e39c2-d098-49cc-977e-25364bb73283 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.615577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.616329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.616618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.616895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.618028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] RBAC: Adding query filter params (interface=public, service_id=e8e5964b883e45b6ae8ee3a137d1c4bd, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.618346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.619787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.626362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 454/899] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/endpoints?service_id=e8e5964b883e45b6ae8ee3a137d1c4bd&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.631697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.632227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.632401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.632683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.632955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.633711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:24.634046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.635722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.652558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 446/900] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:24.657922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.678315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.745093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:24.765458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0394f-be4b-4233-a08a-fd52403231f8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.797920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507a2d3-2c49-4960-9f16-d0786eae074e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:24.805814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.806680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.807067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.807440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.808227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.809793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.816351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 455/901] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:44:24.834242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:24.835099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:24.835383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:24.835661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:24.844848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:24.846409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:24.863304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:24.864934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:24.866954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 447/902] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:24.871677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:24.991678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a07d22-3a6d-444c-84c9-23fc15a4bfa9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:25.029913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:25.030577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:25.030857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:25.031131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:25.032031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:25.032411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:25.033841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:25.053222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 456/903] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:25.058754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:25.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:25.167704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9cbd9-abbc-43e2-8bd0-dc59396b6bf7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:25.204129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:25.205128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:25.205587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:25.206066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:25.280351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:25.281718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:25.353745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:25.386526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 448/904] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:25.392121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:25.402242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:25.497619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ffbf-6cb2-4900-bf08-2a14d819deff None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:25.533272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:25.534521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:25.535003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:25.535474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:25.546768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:25.548496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:25.568099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:25.569027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:25.569950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:25.569950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:25.569950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:25.569950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:25.572215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 457/905] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:25.577995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:25.684176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9121cc-66c9-43bb-8c02-fb0040e71be8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:25.720118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:25.720787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:25.721071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:25.721345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:25.722098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:25.722405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:25.723815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:25.735769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 449/906] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:25.741309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:25.801615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:25.846717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3cc5-6306-403a-889f-16bd25e244d2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:25.883211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:25.884227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:25.884693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:25.885121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:25.892244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:25.893992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:25.908759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:25.909929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:25.911081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:25.913258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 458/907] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:25.918864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:25.952587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:26.035240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdd80-78ab-4b90-9c6f-8e8a2d818107 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:26.071175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:26.072613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.073121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.073597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.074624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:26.075142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:26.076783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe480c39-079b-4a55-ac86-5fce0ec09d7a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:26.089864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 450/908] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:26.099046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:26.209766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb7abc-0de8-4f3e-905c-917b41a2b0a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:26.228068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:26.247389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:26.248430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.248940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.249424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.250504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] RBAC: Adding query filter params (role.id=2d26e5be45304e1bbe9e11190312cbf5, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=76746e56fdda493f8e64e66c03fedcd2) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:26.251028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:26.252664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfca7e4-53ac-43bc-aa6e-7e1b62dbd9da None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:26.259594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 459/909] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:26 2022] GET /identity/v3/role_assignments?user.id=76746e56fdda493f8e64e66c03fedcd2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=2d26e5be45304e1bbe9e11190312cbf5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:26.717674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf513df-bdde-47e9-9fcd-42bf04d6862d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.718046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf513df-bdde-47e9-9fcd-42bf04d6862d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.718266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf513df-bdde-47e9-9fcd-42bf04d6862d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.719996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 451/910] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:26.726214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.726502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.726784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.745020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:26.746259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:26.802911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf80e-ae29-4e28-8c75-d47f48ecfe99 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.803198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf80e-ae29-4e28-8c75-d47f48ecfe99 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.803476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf80e-ae29-4e28-8c75-d47f48ecfe99 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.805130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 452/911] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:26.810470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:26.811001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:26.811481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:26.821776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 460/912] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:26.833933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:26.833933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:26.849123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:26.923060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 453/913] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:26.950940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:26.975334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:26.984138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e06d6-9fd0-4295-95ce-fb17d8c15f87 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:26.996549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:27.021204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.022058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.022342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.022688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.027566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.027566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:27.037769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:27.038913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:27.039827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 461/914] 10.222.0.55 () {56 vars in 1132 bytes} [Tue May 31 20:44:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:27.044922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.070715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94bad-52de-4943-9961-9afc8ecf0420 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.109608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.111057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.111547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.112008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.112944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.114700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ef14e-55e8-42a2-8981-09d6461ce1cf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.150627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dc3c0-64d5-412f-a8f4-7c0fe74d061e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.184965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.185631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.185932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.186212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.186976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:27.187267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.188681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.194418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 462/915] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:27.199765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.204235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 454/916] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:26 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:27.205798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b3afb-97ee-4b49-af0b-a18e9b1d11bb None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.206137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b3afb-97ee-4b49-af0b-a18e9b1d11bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.206405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b3afb-97ee-4b49-af0b-a18e9b1d11bb None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.210170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 455/917] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:27.219549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.219885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.220122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.248872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:27.250570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:27.253696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:27.325205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4390-eff3-4ff6-bd6f-3673b1cc2ea5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.350373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 456/918] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:27.362827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.363560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.363884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.364161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.364892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:27.365200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.366695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.370731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.373421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 463/919] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:27.379105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.386314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:27.495232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c59053-4dc9-43b3-a2c8-444373a04ce0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.498697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a3cb7-1a25-41be-86c6-6f75de85aabd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.500383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:27.538052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.538718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.539001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.539282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.540037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.541650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.542531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.543582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.544085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.544559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.545440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.547354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:27.560986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:27.567771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:27.568624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 457/920] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:27.569708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.630121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 464/921] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:44:27.655380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:27.693316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb573-24be-47a8-af0d-a14d2b02340c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.739046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.739723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.740059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.740339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.741126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:27.741432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.743187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.753666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 458/922] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:27.755060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:27.867911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86d3e-d600-4625-bef6-719b49431867 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:27.905293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:27.906058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:27.906342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:27.906618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:27.907397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:27.907710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:27.909098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f3dea-f849-4fde-891f-012ebddc8a65 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:27.918004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 465/923] 10.222.0.55 () {56 vars in 1114 bytes} [Tue May 31 20:44:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:27.920456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:28.027581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ef986-d1bb-4fc6-a284-e75b966a5f13 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:28.056662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:28.062793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:28.063482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:28.063906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:28.064188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:28.064951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:28.066425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7dd9-c016-486f-97e7-98e088d78cf8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:28.201215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 459/924] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:28.583460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995e75-9388-4fb3-a50c-15d0c06218ad None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:28.584011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995e75-9388-4fb3-a50c-15d0c06218ad None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:28.584011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995e75-9388-4fb3-a50c-15d0c06218ad None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:28.585658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 466/925] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:28.591073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:28.591365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:28.591647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:28.608893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:28.610105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:28.685249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 460/926] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:28.708295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995e75-9388-4fb3-a50c-15d0c06218ad None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:28.734142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:28.814642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995e75-9388-4fb3-a50c-15d0c06218ad None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:28.850912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:28.851668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:28.851948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:28.852222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:28.864115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:28.873002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:28.873935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:28.874788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 467/927] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:28.882510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:28.990011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccce25-0242-43e3-9020-49aa9398e888 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.004439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.026582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.027261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.027547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.027825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.028588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:29.028896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.030286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.039587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 461/928] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:29.045270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.132410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.155723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2162a-cb40-4015-9fde-3688e31ee528 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.190583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.191368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.191675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.191951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.202407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.203849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:29.222053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:29.223600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:29.224485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:29.224485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:29.224485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:29.224485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:29.224485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 468/929] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:29.230613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.341243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658288-6250-49b2-b3fb-657e33977e66 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.375786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.376461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.376745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.377020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.377747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:29.378077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.380036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.392695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 462/930] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:29.398797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.509133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfdcf2-3512-4038-a27c-dced129de9f0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.544690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.545501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.545781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.546080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.548125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.553964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.560294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-93923a2c-1a87-4c3c-90ae-b49b4fcad52d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:29.571779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:29.572761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:29.573708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 469/931] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:29.578871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.615428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.628934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88727-3c39-410b-afa7-9387bbf36c47 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.630087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88727-3c39-410b-afa7-9387bbf36c47 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.630087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88727-3c39-410b-afa7-9387bbf36c47 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.631929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 470/932] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:29.637090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.637403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.637667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.659037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:29.660836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:29.697192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031defdf-177f-448d-9dc6-25410d9a3893 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.734889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.736039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.736528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.737003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.738194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:29.739434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.741323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.761321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 471/933] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:29.769770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 463/934] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:29.773606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.793932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.899321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.909206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8fdf-bc97-4549-b672-46230d05a945 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.910210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff4f99-429e-41d4-9c47-b963dcb0fb93 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:29.939052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:29.951185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.951728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:29.952021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.952298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.955289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.955393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:29.955470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.955541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:29.955541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:29.955678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.965704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:29.967607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:29.969418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:29.970432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:29.971261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:29.974058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 464/935] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:29.976706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:29.994280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:29.995219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:29.996126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:29.996126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:29.996126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:29.996126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:30.003016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 472/936] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:30.004948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.100622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab642b-d09a-41c9-bec8-cc724716a700 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.111965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c91e80-d921-4c58-9c3b-ba9ac1405a19 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.140018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.140834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.141115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.141401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.142117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.142424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.144026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59072429-e3d6-46b9-a6f6-81993b467d0d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.148353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.149029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.149317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.149675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 465/937] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.150202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.151043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38cf2-f547-4f56-8d71-e6579e10dd88 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.151329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38cf2-f547-4f56-8d71-e6579e10dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.151607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38cf2-f547-4f56-8d71-e6579e10dd88 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.151850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.152356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.154028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c252b-25ab-4861-b0af-a7020a69d1ee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.157226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 466/938] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:30.157795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38cf2-f547-4f56-8d71-e6579e10dd88 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.173398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 473/939] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.173398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.173398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.173398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.181958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.191041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:30.197137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:30.221868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.270113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 474/940] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:30.271233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.278694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38cf2-f547-4f56-8d71-e6579e10dd88 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.318741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.319924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.320207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.320501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.321207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.321883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.323665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.329031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 467/941] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.329958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.388735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7431927-d168-4a9f-9448-2028416fc542 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.418777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.434447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.434447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.434447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.434447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.438405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.439048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3cfb-4e5a-48bf-a8f5-78b504466439 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.439904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:30.454329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:30.455230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:30.456118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 475/942] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:30.456621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.479138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.479933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.480249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.480554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.481213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.482611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.493382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:30.494968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:30.495929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:30.496754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 468/943] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:30.497538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.589187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029e78-f77a-4f1d-8bba-bd1661088b71 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.630849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.631522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effd10e-b59b-499f-be2a-de9c47de65d4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.631619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.631779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.632055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.632860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] RBAC: Adding query filter params (interface=public, service_id=e545dc618e9f4125b32732f59ad754fd, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.633170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.634567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.639519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 476/944] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/endpoints?service_id=e545dc618e9f4125b32732f59ad754fd&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.640299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.670262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.670924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.671205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.671482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.672293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.672599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.674054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b780b4e-cefa-4ecd-b4fa-64d3716ccdc6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.686952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 469/945] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.688164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2008-ae97-4ef7-a21b-220441507262 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.688475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2008-ae97-4ef7-a21b-220441507262 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.688752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e2008-ae97-4ef7-a21b-220441507262 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.690014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 470/946] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:30.690721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e2008-ae97-4ef7-a21b-220441507262 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.701422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.736741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:30.746220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16cdf-80fc-4812-b238-6640ce4c4e23 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.779668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.780328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.780608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.780884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.781622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:30.781952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.783316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.790104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 477/947] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:30.790885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:30.800419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e2008-ae97-4ef7-a21b-220441507262 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.837503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.838301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.838587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.838863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.839573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.840941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10c34f-5c0d-4c23-904a-47332077091f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.846992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 471/948] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:44:30.848199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.848481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.848758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.875173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:30.876522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:30.921827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bef32-fe67-4e99-90bc-011dde8e3ccc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:30.969151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:30.970010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:30.970297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:30.970576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/76746e56fdda493f8e64e66c03fedcd2/roles/2d26e5be45304e1bbe9e11190312cbf5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:30.972922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=76746e56fdda493f8e64e66c03fedcd2, role_id=2d26e5be45304e1bbe9e11190312cbf5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:30.974426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:30.981939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 472/949] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:30.981939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:31.001818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:31.064364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 478/950] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:30 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/76746e56fdda493f8e64e66c03fedcd2/roles/2d26e5be45304e1bbe9e11190312cbf5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:44:31.067326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:31.089466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:31.127992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ef39-6ff1-45f8-9c0d-aca7429812f9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:31.182119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:31.183571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:31.184027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:31.184734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:31.185800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:31.186775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:31.188721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:31.189340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dca1f-d3db-47a4-bb79-48fbad9dab7a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:31.196736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 473/951] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:31.235370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:31.235983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:31.236269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:31.236548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:31.237298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:31.239568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:31.241038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING keystone.server.flask.common [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 31 20:44:31.293434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.sql.core [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:44:31.293434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 20:44:31.293434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [parameters: {'id': '066f41b9f28749f1b539258368a2933c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 20:44:31.293434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 066f41b9f28749f1b539258368a2933c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 066f41b9f28749f1b539258368a2933c. May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:44:31.310965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 31 20:44:31.311864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return project_ref.to_dict() May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application yield resource May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise self.value May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application session.commit() May 31 20:44:31.312876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.flush() May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application compat.raise_( May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:44:31.313777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:44:31.314732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:44:31.315667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [parameters: {'id': '066f41b9f28749f1b539258368a2933c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:31.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:31.320017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict( May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 066f41b9f28749f1b539258368a2933c. May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:31.320974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 479/952] 10.222.0.55 () {60 vars in 1140 bytes} [Tue May 31 20:44:31 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:31.321554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:31.402389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:31.439591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4d18-013d-4beb-9717-a329b55be8c3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:31.476198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:31.477007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:31.477286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:31.477557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:31.484581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:31.486400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-06a32344-feac-4d91-9466-9a6e5b26cee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:31.501497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:31.502478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:31.503427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 474/953] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:31.509657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:31.585143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:31.618038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9915371-a5c6-47b9-9992-e4bb44cb87e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:31.653774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:31.654577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:31.654807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:31.655097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:31.655868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:31.656168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:31.657802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9553f-6a07-4219-88ed-1939c42963e6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:31.680712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 480/954] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:33.265140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d760e-5c20-41d5-893f-163e738e94d1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.265847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d760e-5c20-41d5-893f-163e738e94d1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.265847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d760e-5c20-41d5-893f-163e738e94d1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.267302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 475/955] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:33.272911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bbc2-cf70-4ce3-b856-ee344e2a5aad None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.273513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bbc2-cf70-4ce3-b856-ee344e2a5aad None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.273513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586bbc2-cf70-4ce3-b856-ee344e2a5aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.291405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6586bbc2-cf70-4ce3-b856-ee344e2a5aad None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:33.292896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6586bbc2-cf70-4ce3-b856-ee344e2a5aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:33.368029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 481/956] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:33.390824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d760e-5c20-41d5-893f-163e738e94d1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:33.453765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f09ef-9124-4f24-af7a-433dabb5f393 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.454101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f09ef-9124-4f24-af7a-433dabb5f393 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.454366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f09ef-9124-4f24-af7a-433dabb5f393 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.456029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 482/957] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:33.461741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984100-4e53-49d9-ba86-13c049aaec05 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.462066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984100-4e53-49d9-ba86-13c049aaec05 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.462350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40984100-4e53-49d9-ba86-13c049aaec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.484953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-40984100-4e53-49d9-ba86-13c049aaec05 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:33.486679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-40984100-4e53-49d9-ba86-13c049aaec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:33.500608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d760e-5c20-41d5-893f-163e738e94d1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:33.528834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:33.538972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:33.539795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.540075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.540351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.544796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:33.544796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:33.555320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:33.556674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:33.557963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:33.558891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:33.566192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 476/958] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:33.568009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:33.574056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 483/959] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:33.584359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b022-e478-4663-9ec7-6776b1a566c7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.584652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b022-e478-4663-9ec7-6776b1a566c7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.584935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b022-e478-4663-9ec7-6776b1a566c7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.590297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 484/960] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:33.592813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.593107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.593391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.611108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:33.612288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:33.686011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 485/961] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:33.686815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:33.696799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f10d-9446-4884-a6de-a80f17b76a25 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:33.739282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:33.739961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.740295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.740581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.741298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:33.741864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:33.743279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:33.753795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 477/962] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:33.753795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:33.800824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb472220-f1ab-44b3-893c-46d706709313 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:33.817800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:33.824982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:33.839593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:33.840416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.840700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.840977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.852319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:33.860570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:33.861698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:33.862594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 486/963] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:33.863333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:33.873817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8146d-b3fb-4bb0-85c1-399e326f670e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:33.918381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:33.919491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.920261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.920948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.922008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:33.924296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:33.963875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c2a9-a5fb-4d13-951d-2f52d4edcb6d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:33.997096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:33.997754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:33.998075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:33.998351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:33.999055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:33.999360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.000740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.006684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 487/964] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:34.007344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.026006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 478/965] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:33 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:34.026006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.061516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.122658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739596d4-e4d7-4546-99b0-fc1282709a91 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.159888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0039e-8d75-48be-94a5-1032cd1d1872 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.161420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.162132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.162418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.162696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.163460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:34.163765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.165158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c2b8-690a-4060-b07d-ef1a737c3d5f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.173923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.180096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 488/966] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:34.180096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac942c20-7c62-4af6-a331-9f739f329706 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.180096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac942c20-7c62-4af6-a331-9f739f329706 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.180096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac942c20-7c62-4af6-a331-9f739f329706 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.180096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 489/967] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:34.182008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac942c20-7c62-4af6-a331-9f739f329706 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.213550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.215220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.215704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.215986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.216871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.218285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f11ae-76c7-403a-948f-9d7db75e5ce0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.290356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac942c20-7c62-4af6-a331-9f739f329706 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.297369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.325623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.326386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.326666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.326936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.337476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.343334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.343463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 479/968] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:34.343463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.343463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.343463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.361454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:34.362913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:34.371795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:34.372971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:34.373909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:34.373909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:34.373909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:34.373909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:34.373909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 490/969] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:34.380210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.459229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 480/970] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:34.484368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.516016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4943ca-6697-4da4-9705-806876c13404 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.561165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.561848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.562147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.562430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.563169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:34.563480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.564861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.579258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 491/971] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:34.584973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.594423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.604255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a464-5dc3-4709-a9bc-027deb95de5d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.612184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.651295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.652132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.652413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.652992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.654035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.655483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.657441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING keystone.server.flask.common [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 31 20:44:34.695040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959008b6-b57a-4dd2-88ce-801bbd496d6e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.727720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.sql.core [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:44:34.727720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 20:44:34.727720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [parameters: {'user_id': '52ed7fcae8f24bd3b1d2f10d05b0184f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 20:44:34.727720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 20:44:34.730651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.731465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.731745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.732015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() May 31 20:44:34.737371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:44:34.738829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application yield resource May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.rollback() May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.force_reraise() May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise self.value May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application session.commit() May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 20:44:34.739802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._prepare_impl() May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.flush() May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._flush(objects) May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application compat.raise_( May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application flush_context.execute() May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rec.execute(self) May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 20:44:34.741201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = connection._execute_20( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 20:44:34.742668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 20:44:34.743724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [parameters: {'user_id': '52ed7fcae8f24bd3b1d2f10d05b0184f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:34.746739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 31 20:44:34.747597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.748491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 481/972] 10.222.0.55 () {60 vars in 1131 bytes} [Tue May 31 20:44:34 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:34.748898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.748898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.751771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:34.763186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:34.769964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 492/973] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:34.770961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.872728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:34.896445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6de5-ea13-4011-9929-76a4f62fc524 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.900769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f634-2b44-45ef-939e-3cd367f8b8b4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:34.936092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.936778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.937064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.937344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.938389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:34.938705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.940750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.944495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:34.945537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:34.946168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:34.946666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:34.955155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:34.957780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:34.962112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 493/974] 10.222.0.55 () {56 vars in 1149 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:34.966961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:34.979167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:34.980152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 20:44:34.981108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:34.983897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 482/975] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:34.995118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:35.018061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.088837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b407d13-d068-483e-83f2-0e6bfac46194 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:35.126587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:35.127578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:35.128111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:35.129170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:35.131473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0831-b163-4894-8780-1dac08e2fd66 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:35.133601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.168032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:35.168246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:35.168488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:35.168746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:35.169562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:35.169857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:35.171320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:35.205928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:35.207894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:35.222686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 483/976] 10.222.0.55 () {56 vars in 1101 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:35.332880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 494/977] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:34 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:44:35.339053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:35.419029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.450524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7642a3-0cfc-4c7e-8162-93c6cd6225dd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:35.485573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:35.486403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:35.486681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:35.486953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:35.499386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:35.500844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:35.518509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:35.519459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:35.520571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:35.520571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:35.520571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:35.520571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:35.520571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 484/978] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:35.526785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:35.565588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.640375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524c8c-d9f7-4ad9-b1f5-1c08a55dddaf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:35.675986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:35.676581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:35.676872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:35.677140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:35.677861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:35.678198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:35.679556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:35.691452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 495/979] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:35.696924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:35.807907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63924-31b2-46bf-af11-46748e79df2c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:35.832449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.842993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:35.843786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:35.844065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:35.844344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:35.851638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:35.853070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:35.867706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:35.868833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:35.870126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:35.872995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 485/980] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:35.879146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:35.978880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:35.985574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd961d-5b39-4bc7-955c-5ca84bcb7dd9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.020890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.021572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.021858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.022165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.022965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:36.023278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.024710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a572e07-e06d-4f6d-b6d2-3dcf16d9f1af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.043781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 496/981] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:36.045310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.152929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747747a-23b8-4a76-b7b0-406d4601f847 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.187871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.188540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.188826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.189113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.189986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] RBAC: Adding query filter params (role.id=2d26e5be45304e1bbe9e11190312cbf5, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=76746e56fdda493f8e64e66c03fedcd2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:36.190308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.192266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d4f01-138a-4fbc-ba07-4c72387016da None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.203559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 486/982] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/role_assignments?user.id=76746e56fdda493f8e64e66c03fedcd2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=2d26e5be45304e1bbe9e11190312cbf5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:36.379283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b03ab-e151-4dba-826b-1ff7c8c6f71e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.379805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b03ab-e151-4dba-826b-1ff7c8c6f71e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.379805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b03ab-e151-4dba-826b-1ff7c8c6f71e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.381241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 497/983] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:36.387531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.387839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.388106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.407832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:36.409411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:36.456915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:36.479531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 487/984] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:36.502826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b03ab-e151-4dba-826b-1ff7c8c6f71e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.607675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b03ab-e151-4dba-826b-1ff7c8c6f71e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.641974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.642700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.642986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.643263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.643926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.645314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-169d7770-748b-4e2f-853c-e9c4d7f9d7d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:36.657083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:36.658090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:36.658911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:36.661959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 498/985] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:36.664381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.706614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4987-1d98-4f72-97ff-e854660c6782 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.706903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4987-1d98-4f72-97ff-e854660c6782 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.707187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4987-1d98-4f72-97ff-e854660c6782 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.708897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 499/986] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:36.713797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.714118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.714402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.731318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:36.732580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:36.749457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:36.771403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce68e-c4a3-42ac-b057-24c7932379ec None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.812299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.813080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.813463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 500/987] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:36.818236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.818615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.819442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:36.819833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.821311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.826829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 488/988] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:36.832380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.836809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.882446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:36.941207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c98199-96d9-40df-a9b3-01d2f634959b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.944594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bffa59-94cf-477c-86f0-6513f99a7fb3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:36.978117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.978928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.979208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.979597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.980199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.981117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:36.981639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.981813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:36.982078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:36.982350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:36.983069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:36.983370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:36.984743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:36.990417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 501/989] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:36.996361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:36.996510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:36.997439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:36.998388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 489/990] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:37.004398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:37.016568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:37.106468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968d202-fdd2-4ff8-8122-01114e21956f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.107778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002b5b-5a29-48be-99ef-3df7fd676fce None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.116088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:37.143180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a86752-efb7-4169-aead-4698233111af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.143917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86752-efb7-4169-aead-4698233111af None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.144522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.144711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86752-efb7-4169-aead-4698233111af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.144957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86752-efb7-4169-aead-4698233111af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.145184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.145465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.145748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a86752-efb7-4169-aead-4698233111af None admin] RBAC: Adding query filter params (interface=public, service_id=1daf926c52dd4017a3512eca80bfa038, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:37.145935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.146090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a86752-efb7-4169-aead-4698233111af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.146593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:37.146897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.147451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a86752-efb7-4169-aead-4698233111af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.148317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.152771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 502/991] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:36 2022] GET /identity/v3/endpoints?service_id=1daf926c52dd4017a3512eca80bfa038&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:37.158739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 490/992] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:37.158872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a86752-efb7-4169-aead-4698233111af None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:37.159518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:37.239753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:37.264105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a86752-efb7-4169-aead-4698233111af None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.278198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b8964-b817-4b57-9491-904ffbe306fe None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.303671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.304352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.304636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.304918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.305609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.307016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.313770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 503/993] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:37 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 20:44:37.318221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.318970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.319292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.319572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.320311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:37.320761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.322144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.330069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 491/994] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:37.336459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:37.451038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d5310-d232-4ca0-938e-57142f6e09cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.490502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.491102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.491657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.491935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.492762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] RBAC: Adding query filter params (interface=admin, service_id=e545dc618e9f4125b32732f59ad754fd, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:37.493084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.494537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad7705-5bd3-4a5d-b881-467d2456b674 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.505038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 504/995] 10.222.0.55 () {56 vars in 1249 bytes} [Tue May 31 20:44:37 2022] GET /identity/v3/endpoints?service_id=e545dc618e9f4125b32732f59ad754fd&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:37.506379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:37.543982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:37.610858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889fe2-614e-4c97-92b5-337c9f8f41f0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:37.646646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:37.647315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:37.647600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:37.647875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:37.648560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:37.649959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18c42-5a10-429c-96d2-10fe53910754 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:37.656330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 492/996] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:37 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:44:38.500878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83081a5e-3297-4e3b-a095-fdf676029513 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:38.501424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83081a5e-3297-4e3b-a095-fdf676029513 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:38.501424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83081a5e-3297-4e3b-a095-fdf676029513 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:38.502863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 505/997] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:38.508087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:38.508480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:38.508662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:38.525506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:38.526790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:38.600857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 493/998] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:38.623560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83081a5e-3297-4e3b-a095-fdf676029513 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:38.632469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:38.731236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83081a5e-3297-4e3b-a095-fdf676029513 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:38.765176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:38.765927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:38.766264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:38.766539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:38.767212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:38.769396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:38.785955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:38.787087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:38.787967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:38.792980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 506/999] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 31 20:44:38 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:38.795354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:38.829168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:38.902777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c1165-adf8-437a-a0be-26aa5ab82b4e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:38.938456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:38.939426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:38.940026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:38.940480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:38.941455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] RBAC: Adding query filter params (name=image) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:38.941970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:38.943499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457807e-3869-45c9-8028-081d0bcd7301 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:38.953314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 494/1000] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:38.955030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:39.028068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:39.060248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476934d-e00f-4401-aeac-b5f630e18201 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:39.095408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:39.096071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.096355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.096630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.097366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:39.097665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:39.099058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738accc-21ed-452d-bbe8-613d66714ef7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:39.107712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 507/1001] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:39.614174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5496e-5d74-45c6-a492-8de3b711ac8f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.614704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5496e-5d74-45c6-a492-8de3b711ac8f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.614704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5496e-5d74-45c6-a492-8de3b711ac8f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.616151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 495/1002] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:39.622491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.622995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.623099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.641131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:39.642358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:39.709241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 508/1003] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:39.731573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5496e-5d74-45c6-a492-8de3b711ac8f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:39.856136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:39.867243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5496e-5d74-45c6-a492-8de3b711ac8f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:39.900358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:39.901165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.901454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.901730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.902690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:39.904382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6cd8de54-ddfe-465a-8a89-0967665f552a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:39.917325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:39.918493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 20:44:39.919403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:39.921977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 496/1004] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:39.924989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:39.940944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304de8-9ccd-4e9a-951f-fbd1c0645cde None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.941240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304de8-9ccd-4e9a-951f-fbd1c0645cde None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.941514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304de8-9ccd-4e9a-951f-fbd1c0645cde None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.942941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 497/1005] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:39.947957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:39.948695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:39.948695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:39.965339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:39.966571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:39.997034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:40.035687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7351ac-f2e6-4772-aa55-ee4ef9be283b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.041935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 498/1006] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:40.061506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.075266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.075940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.076228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.076506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.077223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:40.077534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.078994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.084331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 509/1007] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:40.089867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.156434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:40.172937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78197a03-5bbe-4758-8f09-4a5a40788db1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.200412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ed03-fbe9-47e9-9c2c-9cf6ef349f02 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.210350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.211595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.211885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.212258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.212955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.214568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:40.228892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:40.230375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:40.231702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 499/1008] 10.222.0.55 () {56 vars in 1126 bytes} [Tue May 31 20:44:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:40.233786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:40.236418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.242887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.243661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.243945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.244225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.244944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:40.245252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.246655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.251728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 510/1009] 10.222.0.55 () {56 vars in 1112 bytes} [Tue May 31 20:44:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:40.257184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.347515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734017a1-a64f-415f-9701-6c339af2f91f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.362458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cd00-e01c-4823-a0db-0a32f53801eb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.382999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.383785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.384068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.384343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.385055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:40.385361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.386766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.396789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 500/1010] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:40.397846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.403438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.404236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.404628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.405011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.405862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.407427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.414736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:40.497825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5bdd-013f-4cd8-8d32-2d473d59b335 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.525937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 511/1011] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:44:40.549715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.550462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.550745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.551023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.551745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:40.552056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.553448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c012b-b091-480b-8794-4965a73d9571 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.559516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 501/1012] 10.222.0.55 () {56 vars in 1122 bytes} [Tue May 31 20:44:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:40.566259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:40.621464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:40.677129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1557-5936-4f48-a53e-47347f4a6d66 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:40.715031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:40.715990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:40.716280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:40.716557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:40.717323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:40.718813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d671c-689b-4723-8756-2de5ea510f16 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:40.813538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 512/1013] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:44:41.360959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964a11-371d-4d43-9066-b60799e7babf None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:41.361517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964a11-371d-4d43-9066-b60799e7babf None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:41.361517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964a11-371d-4d43-9066-b60799e7babf None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:41.363071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 502/1014] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:41.368489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787f47-445d-4d15-a893-f4da8b6f418a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:41.368783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787f47-445d-4d15-a893-f4da8b6f418a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:41.369063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787f47-445d-4d15-a893-f4da8b6f418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:41.386247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ea787f47-445d-4d15-a893-f4da8b6f418a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:41.387437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ea787f47-445d-4d15-a893-f4da8b6f418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:41.461066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 513/1015] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:41.483032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964a11-371d-4d43-9066-b60799e7babf None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:41.562496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:41.589849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1964a11-371d-4d43-9066-b60799e7babf None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:41.624709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:41.625306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:41.625591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:41.625872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:41.626628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:41.627988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0dcba-1c0e-4a89-b14f-dbd4e7c72a7e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:41.745780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 503/1016] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:41 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:44:42.936379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e435-c41d-4af4-acdb-b41d08b684f7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:42.936908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e435-c41d-4af4-acdb-b41d08b684f7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:42.936997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0e435-c41d-4af4-acdb-b41d08b684f7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:42.938541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 514/1017] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:42.944543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a8a9-991c-4760-a024-1f18488079f2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:42.945000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a8a9-991c-4760-a024-1f18488079f2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:42.945092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a8a9-991c-4760-a024-1f18488079f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:42.962838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1be8a8a9-991c-4760-a024-1f18488079f2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:42.964043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1be8a8a9-991c-4760-a024-1f18488079f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:43.047820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 504/1018] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:43.071953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0e435-c41d-4af4-acdb-b41d08b684f7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.108209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504545c-fbbc-4b74-b5c0-0833abf2f554 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.108501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504545c-fbbc-4b74-b5c0-0833abf2f554 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.108783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504545c-fbbc-4b74-b5c0-0833abf2f554 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.109045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.110609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 505/1019] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:43.115746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.121260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.121260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.133926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:43.135124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:43.181074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0e435-c41d-4af4-acdb-b41d08b684f7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.196763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.208175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 506/1020] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:43.219965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.221076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.221589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.222132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.231556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.233403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:43.243012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:43.244107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:43.245060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 515/1021] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:43.250245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.347907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc2a3f-800c-41fc-b3ce-8ec52ab2e7d5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.349977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.357226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41561f2-8512-4e39-b2a4-4251cc7967b6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.390941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.391945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.392361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.392606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.393593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.393910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.394835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.395180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.395421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.395537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.396178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:43.396485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.401699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 507/1022] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:43.401854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.403158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.408521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 516/1023] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:43.414131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.469089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.513478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cea0b-ac00-4e44-9630-d38f8c63cdbc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.520178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b51926-d4e1-4c6e-a336-b4d0331a9831 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.549013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.549685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.550583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.550863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.551572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.552997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.555249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.556048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.556341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.556617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.567480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.568935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:43.586177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:43.587289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:43.588292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:43.588292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:43.588292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:43.588292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:43.588292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 517/1024] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:43.592942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.604697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.660580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 508/1025] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:44:43 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:43.700957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf4457-888f-48e9-8502-89a4c8a86fe6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.742524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.743189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.743478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.743760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.744502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:43.744819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.746539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.759981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 518/1026] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:43.765862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:43.877461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987df0-5301-4fe3-9057-e6971fa4c415 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:43.888401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:43.913957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:43.914762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:43.915056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:43.915335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:43.923876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:43.925813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a3c81649-da66-42dc-84ba-7f402a612ce0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:43.941036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:43.942438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:43.943416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 509/1027] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:43.948210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.018207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.041746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e28ab-dd3f-4135-b5f3-60548eb7f1d7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.042317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e28ab-dd3f-4135-b5f3-60548eb7f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.042422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e28ab-dd3f-4135-b5f3-60548eb7f1d7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.043900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 510/1028] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:44.048791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.049085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.049370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.056192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64026-c58c-445c-9ecf-b9497ce614f3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.066090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:44.067280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:44.092328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.093355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.093649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.093950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.094876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:44.095189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.097239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.119934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 519/1029] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:44:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:44.121373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.150033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 511/1030] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:44.172063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.228256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b523bb6-2415-456c-a7c0-ec81d75b307b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.255492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.264421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.267804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.267804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.267804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.281544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.285247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c655-729f-4fb0-b3af-b8a7ab6ac479 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.326038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.327014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.327631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.327920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] PATH_INFO: `/v3/services/image` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.328779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.330257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.342140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:44.342804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:44.343842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:44.344706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 512/1031] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:44.345564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.350273 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.454448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 520/1032] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:44.455844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.462949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601d24-b673-4296-aec7-f2e4347d5265 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.483255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.500883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.501582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.501870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.502178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.503435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:44.503745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.505126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.510420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 513/1033] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:44.516157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.546904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.568161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd821-dbe7-4116-855a-2f83fb1705df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.610010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.611242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.611526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.611940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.621952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e1b57-96ca-405f-89e6-2986774d18e1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.623057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.624630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:44.643302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:44.644823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:44.645757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:44.645757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:44.645757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:44.645757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:44.645757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 521/1034] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:44.650748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.661206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.662253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.662677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.663105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.663819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] RBAC: Adding query filter params (type=image) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:44.664135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.665468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.671483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 514/1035] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:44.678055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.733500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.761435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3e3cf-ae20-415c-8de5-44d0909b433e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.778287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.800283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb0a33-5852-4063-8acc-8f8ab448362e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.800414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.800414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.800414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.800414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.800771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:44.800843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.802225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.819184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 522/1036] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:44.820274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.831740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.832413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.833103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.833397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.834556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] RBAC: Adding query filter params (interface=public, service_id=7ed1040f204c4e29b94c56ba2ed91d01, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:44.834881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.836399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.842555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 515/1037] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/endpoints?service_id=7ed1040f204c4e29b94c56ba2ed91d01&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:44.848306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:44.935658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133dbaa-53e6-4522-8c00-e33ae922d93d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.955752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57c74e-3606-45c9-b2a6-feb9fb103d61 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:44.974087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:44.974894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:44.975177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:44.975454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:44.983330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:44.984601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:44.986329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:44.992610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:45.000542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:45.000542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:45.000542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:45.000542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:45.000542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:45.000904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:45.001787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:45.003910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:45.007479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 523/1038] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:45.008251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:45.012620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 516/1039] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:44:44 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:44:45.120001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbcbb-f821-4e1f-829c-01fee6999cad None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:45.156303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:45.156991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:45.157272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:45.157579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:45.158391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:45.158703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:45.160691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8a78d-0c96-45db-ae4c-fb6b726c5700 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:45.179141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 524/1040] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:45.181110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:45.205633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:45.286859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d59a-a5e2-433b-9e0a-46806f041e9f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:45.326729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:45.327886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:45.328346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:45.328797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:45.329880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] RBAC: Adding query filter params (role.id=2d26e5be45304e1bbe9e11190312cbf5, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:45.330419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:45.332047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e478355-264e-44a8-8fe2-af25a7d25b10 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:45.339291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 517/1041] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:45 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=2d26e5be45304e1bbe9e11190312cbf5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:46.007258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4debb2-4ec2-4923-9491-d58c621750eb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:46.007848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4debb2-4ec2-4923-9491-d58c621750eb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:46.007848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4debb2-4ec2-4923-9491-d58c621750eb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:46.009386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 525/1042] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:46.015077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:46.015370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:46.015653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:46.033321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:46.034573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:46.105769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 518/1043] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:46.128288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4debb2-4ec2-4923-9491-d58c621750eb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:46.192354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:46.237852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4debb2-4ec2-4923-9491-d58c621750eb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:46.272189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:46.273206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:46.273657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:46.274111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:46.275446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:46.277009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445820c-1b39-4912-bb75-37b5b123b0e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:46.283738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 526/1044] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:46.284967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:46.301001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:46.389005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f45dd-76c1-43e0-a89b-ee593139bc95 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:46.422957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:46.423637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:46.423925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:46.424188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:46.425432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:46.426885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ed2c-baff-4405-b143-8e6cf8332caa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:46.569931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 519/1045] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:44:46 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:47.307439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925610-a6f1-4ca8-990d-99c52ff5739a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.307970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925610-a6f1-4ca8-990d-99c52ff5739a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.308076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925610-a6f1-4ca8-990d-99c52ff5739a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.309577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 527/1046] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:47.314907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1d1-1413-40a6-ac99-30bb335f10e3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.315352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1d1-1413-40a6-ac99-30bb335f10e3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.315562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d1d1-1413-40a6-ac99-30bb335f10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.333369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4e50d1d1-1413-40a6-ac99-30bb335f10e3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:47.334601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4e50d1d1-1413-40a6-ac99-30bb335f10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:47.401201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:47.409936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 520/1047] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:47.431118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925610-a6f1-4ca8-990d-99c52ff5739a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:47.534832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925610-a6f1-4ca8-990d-99c52ff5739a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:47.560571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:47.569577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:47.570417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.570706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.572310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.572310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:47.573019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:47.582247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7515-ab09-4f05-aa3d-ee7cc0620822 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.582611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7515-ab09-4f05-aa3d-ee7cc0620822 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.582826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f7515-ab09-4f05-aa3d-ee7cc0620822 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.584370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 521/1048] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:47.584934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:47.586238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 20:44:47.587175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:47.589191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.589486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.589765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.591527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 528/1049] 10.222.0.55 () {56 vars in 1105 bytes} [Tue May 31 20:44:47 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:47.592381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:47.608255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:47.609832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:47.689143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 522/1050] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:47.704978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a887d-1029-4944-9cc4-e93c4068f534 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:47.713232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:47.742172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:47.742849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.743135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.743418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.744136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] RBAC: Adding query filter params (name=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:47.744442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:47.745850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:47.751593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 529/1051] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:47.757156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:47.822491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:47.833381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f6c99-2a60-44c6-8b54-97109b6fd08a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:47.864310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:47.869596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72de0-fe85-493c-942b-37ecab395d44 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:47.870753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:47.871736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.872018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.872413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.882652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:47.891305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:47.892272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:47.894035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 523/1052] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:47.899117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:47.911306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:47.911993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:47.912277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:47.912555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:47.913274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:47.913582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:47.914983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:47.924734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 530/1053] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:47.925910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.008426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f05d-6fd5-4ec6-a6b0-433ae43cc3f4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.031641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be911b-31db-4520-a3c9-edcde1299dee None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.045443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.046144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.046426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.046702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.047451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:48.047756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.049129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.049816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:48.057570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 524/1054] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:48.063320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.067431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.068090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.068370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.068645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.069367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.070783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.123648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:48.156410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 531/1055] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:44:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:44:48.170613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef7d3-d1b3-4961-8e03-6190dea37e77 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.218458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.219324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.219610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.219882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.232556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.234114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:48.254367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:48.255340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:48.261619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:48.261619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:48.261619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:48.261619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:48.261619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 525/1056] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:48.261971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.379987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95082ab7-ce45-4324-8aa7-e6461cf3f836 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.418939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.419618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.419897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.420169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.420895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:48.421199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.422582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.439692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 532/1057] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:48.442069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.543147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:48.546567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27600-9a78-4d8c-a66f-0047a32de334 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.579867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.580723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.581004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.581277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.590898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.592390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:48.608566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:48.609656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:48.616841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 526/1058] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:48.619699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.661061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:48.726795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2917-3be8-4300-b71e-c80062a2d174 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:48.765299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:48.767987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.767987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.767987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.769059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:48.769617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:48.772491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00e7f6-4996-405d-aead-eb45a93dbabf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:48.861918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 533/1059] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:44:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:48.864608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:48.925554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72fc6-d7b4-47c6-a83b-becec1aedf09 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.925754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72fc6-d7b4-47c6-a83b-becec1aedf09 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.926057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72fc6-d7b4-47c6-a83b-becec1aedf09 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.927670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 534/1060] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:48.932706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:48.932998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:48.933278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:48.952421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:48.953933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:48.973784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d39c4-ead5-471a-804c-6a1329c7b738 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.010010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.010813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.011098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.011495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.022836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.024301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.032004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 535/1061] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:49.043810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:49.044706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:49.045653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:49.045653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:49.045653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:49.045653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:49.045653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 527/1062] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:49.051275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.057691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.074900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.076529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.152261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d68c-d548-4741-94a0-efab270fd8e8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.164120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c690-a7e9-4a3a-aa94-96ee6cd8e609 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.188932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.189776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.190156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.190501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.191250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:49.191563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.192946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.200166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.200955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.201234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.201502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.206785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 536/1063] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:49.212905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.213235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:49.220883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:49.222493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:49.223345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:49.227966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 528/1064] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:49.228688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.300893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.308536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.321156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c646-763b-4000-bb2c-43618f9e4da6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.340912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9388390-6a2a-4974-a79c-9387e45e3388 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.357047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.357854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.358197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.358475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.366898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.368369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.380704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.381588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.382089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:49.382486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:49.383836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:49.384963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:49.385619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.386582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:49.387098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.388585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 537/1065] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:49.389097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.389496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.399153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 529/1066] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:49.404852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.511584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3fd2-90e8-49d4-b060-26cadb83d5b1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.516589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acc63-c0fc-474e-96fb-bbdc235e7061 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.548936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.549628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.549928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.550205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.551118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:49.551435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.552914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.554218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.555437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.555722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.556002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] PATH_INFO: `/v3/users/f2d1aa264a5b4e0598403f584924b26b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.558135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.566039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 538/1067] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:49.572034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.575506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d1aa264a5b4e0598403f584924b26b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.575506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.575689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.581929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 530/1068] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/users/f2d1aa264a5b4e0598403f584924b26b => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:49.583001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.677300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156e160-42ae-4674-8b29-d528cb8f4be4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.684322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d3f6c-739f-4008-b3a8-fb3ccd8f3398 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:49.714720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.715750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.716036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.716408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/2d26e5be45304e1bbe9e11190312cbf5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.719098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=0ac9c94438bf4a0b8a603d472ca317f2, role_id=2d26e5be45304e1bbe9e11190312cbf5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.719532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:49.720186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:49.720473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:49.720632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.720738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:49.779194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:49.788472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:49.789965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:49.802391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 539/1069] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:49 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/0ac9c94438bf4a0b8a603d472ca317f2/roles/2d26e5be45304e1bbe9e11190312cbf5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:44:49.913849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 531/1070] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:49.919532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:49.988455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:50.029880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772fba1-7d35-4a05-9fc1-b1b4610ccd56 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:50.064374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:50.066137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:50.066462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:50.066918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:50.068586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:50.070115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf6e9c-7b3e-4443-b670-c5cab1cbd1d9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:50.072034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 540/1071] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:44:49 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:50.078296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:50.174052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:50.183929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0173a-f46b-4472-98dd-a2ba5a8372e7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:50.219457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:50.220124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:50.220409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:50.220689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:50.221562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=32d47ecc05fc4bf9909316ef7edb0409, user.id=f2d1aa264a5b4e0598403f584924b26b) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:50.221877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:50.223422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91b5f6-711f-4ba8-a193-4277be884c06 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:50.229376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 532/1072] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:50 2022] GET /identity/v3/role_assignments?user.id=f2d1aa264a5b4e0598403f584924b26b&scope.project.id=32d47ecc05fc4bf9909316ef7edb0409&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:50.460929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741610e-5ed2-4d5a-8007-aa3edb783d06 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:50.461446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741610e-5ed2-4d5a-8007-aa3edb783d06 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:50.461524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741610e-5ed2-4d5a-8007-aa3edb783d06 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:50.463031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 541/1073] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:50.468094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:50.468463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:50.468824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:50.486010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:50.487229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:50.557956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 533/1074] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:50.581914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741610e-5ed2-4d5a-8007-aa3edb783d06 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:50.687902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741610e-5ed2-4d5a-8007-aa3edb783d06 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:50.723111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:50.724397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:50.724900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:50.725388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:50.734299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:50.796751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:50.798501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:50.940492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 542/1075] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:50.941767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:51.039287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:51.059020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee515e-5145-4b21-8b8d-3bca318d07c3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:51.097182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:51.098010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:51.098295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:51.098568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:51.108759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:51.110235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-edfa6b1f-b5ad-46de-8f69-43e290d4acbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:51.129684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:51.130774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:51.131665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:51.131665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:51.131665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:51.131665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:51.132370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 534/1076] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:51.136974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:51.168496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:51.239097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa4815-8d8f-4e2a-a67c-753c32307911 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:51.272592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:51.273252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:51.273532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:51.273807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:51.274554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:51.274861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:51.276216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9d9c-4725-4072-ae6c-a948daafcdf8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:51.294002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 543/1077] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:52.103329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95959-d4bb-4e49-9e23-956ba6d3d02e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.103834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95959-d4bb-4e49-9e23-956ba6d3d02e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.103834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d95959-d4bb-4e49-9e23-956ba6d3d02e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.105180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 535/1078] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:52.110568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.110976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.111142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.128797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:52.130024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:52.204318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 544/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:52.228157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95959-d4bb-4e49-9e23-956ba6d3d02e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.331698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d95959-d4bb-4e49-9e23-956ba6d3d02e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.366320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.367063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.367347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.367621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.374670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:52.379149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9d2904c7-f189-4cc3-9dc9-37410e3791e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:52.387709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:52.389645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:52.390759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 536/1080] 10.222.0.55 () {56 vars in 1120 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:52.395592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.417318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:52.495801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895f0ac-615d-4116-9d3e-3c350794719f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.501488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969e6a8-6fdd-461e-9a8b-b6d0f02d8be0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.501779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969e6a8-6fdd-461e-9a8b-b6d0f02d8be0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.502099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969e6a8-6fdd-461e-9a8b-b6d0f02d8be0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.503585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 537/1081] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:44:52.508802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.509088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.509372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.526675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:52.527943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:52.530391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.531071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.531361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.531641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.532400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:52.532711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:52.534693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:52.543419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 545/1082] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:52.549471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.596744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 538/1083] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:44:52.619524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.631584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:52.649633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedf146-a58d-4ed9-bbdf-aac5038664ae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.684234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.685036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.685317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.685592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.696602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:52.698088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:52.715664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:52.716738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:52.717645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:52.717645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:52.717645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:52.717645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:52.717645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 546/1084] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:52.722877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.723337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab41d-f50c-4ff1-8c18-ffea0c80d32e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.750593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:52.758898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.759702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.762660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.762660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.772863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:52.780683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:52.781822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:52.782691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 539/1085] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:52.788264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.825643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0372b-078f-45d4-b2a2-7f1f62a51f02 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.858457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.859117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.859399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.859678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.860404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:52.860708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:52.862147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:52.863597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:52.877719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 547/1086] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:52.880518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.891347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553c80e-c195-45f1-b0ac-fbb6e695919c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.925960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:52.926633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:52.926912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:52.927186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:52.927934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:52.928239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:52.929598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:52.937633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 540/1087] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:52.943998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:52.978334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852aba-f5b4-4685-b4ce-75def4ddd332 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:52.992891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.012658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.013498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.013784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.014097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.021382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.022851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:44:53.037297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:53.038617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:53.039853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 548/1088] 10.222.0.55 () {56 vars in 1093 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:53.040446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706a99e-14e1-494b-86bf-387ab11a32e2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.044431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.075097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.075958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.076250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.076512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] PATH_INFO: `/v3/users/f2d1aa264a5b4e0598403f584924b26b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.077694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] RBAC: Authorizing `identity:get_user(user_id=f2d1aa264a5b4e0598403f584924b26b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.079135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.080779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 541/1089] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:44:52 2022] GET /identity/v3/users/f2d1aa264a5b4e0598403f584924b26b => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:53.086462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.102124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.145857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f4d6e-730e-4ae4-a4cc-5fe8b10ec271 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.179517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.180188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.180466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.180743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.181583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:53.181914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.183345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.186362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10672f-dd4e-48eb-8d27-bff3022b46bc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.200577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 549/1090] 10.222.0.55 () {56 vars in 1133 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:53.203622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.206229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.220210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.226322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 542/1091] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:44:53.231790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.305833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d844-4084-40f6-b824-424d727b1181 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.320114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.331025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310bd72-09bf-45f6-8054-1277aa4a1976 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.340604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.341392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.341747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.342123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.364750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.365884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.366191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.366462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409/users/f2d1aa264a5b4e0598403f584924b26b/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.368418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] RBAC: Authorizing `identity:create_grant(project_id=32d47ecc05fc4bf9909316ef7edb0409, user_id=f2d1aa264a5b4e0598403f584924b26b, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.369830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.409328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.410720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.463496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 543/1092] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:44:53 2022] PUT /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409/users/f2d1aa264a5b4e0598403f584924b26b/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 20:44:53.511755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 550/1093] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:44:53.517729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.569116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.629501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18c8b8-368d-4ca5-b993-795d06fc8be1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.668950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.669675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.670064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.670349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.681217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.682789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:44:53.699742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:53.700796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:53.701717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:44:53.701717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:44:53.701717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:44:53.701717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:53.701717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 544/1094] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:53.707241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.722859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.810384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802b66-9d93-470b-83ff-08e42d2f8699 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:53.845314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:53.846636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:53.847435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:53.847435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:53.847916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:53.848231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:53.849597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:53.861208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 551/1095] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:53.866996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:53.965664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:53.969686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe304b-621a-4132-acd7-c4c838751bde None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:54.004251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:54.005068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:54.005351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:54.005624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:54.012308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:54.013738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:44:54.027805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:54.028711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:44:54.029601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 545/1096] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:44:54.035509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:54.103866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:54.133215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56c80-507a-4f3d-837e-128a55e23fe1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:54.166526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:54.167173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:54.167456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:54.167736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:54.168517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:54.168826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:54.170293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b764-f22e-4eca-b5bc-bcd56a37a61e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:54.182300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 552/1097] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:54.188380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:54.288527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565237cf-ea8b-4c96-8af5-658cd396a8cd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:54.322420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:54.323085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:54.323365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:54.323637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:54.324521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] RBAC: Adding query filter params (role.id=2d26e5be45304e1bbe9e11190312cbf5, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=0ac9c94438bf4a0b8a603d472ca317f2) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:54.324836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:54.326281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211928c1-ea9e-4b10-bf3a-cb231359121e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:54.332724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 546/1098] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:54 2022] GET /identity/v3/role_assignments?user.id=0ac9c94438bf4a0b8a603d472ca317f2&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=2d26e5be45304e1bbe9e11190312cbf5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:55.706347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf474ca-5b39-4f20-866d-0049197474d4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:55.706917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf474ca-5b39-4f20-866d-0049197474d4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:55.706917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf474ca-5b39-4f20-866d-0049197474d4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:55.708280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 553/1099] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:55.713473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:55.713868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:55.714072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:55.732153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:55.733343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:55.750158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:55.801556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 547/1100] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:55.825051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf474ca-5b39-4f20-866d-0049197474d4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:55.925161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf474ca-5b39-4f20-866d-0049197474d4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:55.953377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:55.966383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:55.966383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:55.966383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:55.966383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:55.969522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:44:55.977687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:44:55.978783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:44:55.979771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 554/1101] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:44:55.985011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:56.080773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a523a-8c7c-459e-933b-40ae39656ab1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:56.113354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:56.114036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:56.114318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:56.114588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:56.115588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:56.115887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:56.117249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:56.125034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 548/1102] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:56.130876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:56.228804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f5086-63ce-499c-90b2-999eb1aed210 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:56.260799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:56.261660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:56.261975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:56.262256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] PATH_INFO: `/v3/users/f2d1aa264a5b4e0598403f584924b26b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:56.263433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] RBAC: Authorizing `identity:get_user(user_id=f2d1aa264a5b4e0598403f584924b26b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:56.264869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:56.266528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 555/1103] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:44:56 2022] GET /identity/v3/users/f2d1aa264a5b4e0598403f584924b26b => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:56.272843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:56.289156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:56.369463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73a49-65ba-4efe-b22f-22c2171a74d3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:56.402212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:56.402858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:56.403134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:56.403406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:56.467121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:56.468550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:56.482139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:56.561963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 549/1104] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:44:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:44:56.568431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:56.626030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:56.665321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289626-89e4-4ecf-9e21-ee638a98886b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:56.698234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:56.699090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:56.699391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:56.699650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:56.700819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:56.702279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885c4a-2770-4166-b1c6-e579701106c9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:56.703981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 556/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:44:56 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:56.710406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:56.808017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7c44-08e7-445c-b7ba-b01185a04031 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:56.822215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:56.841500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:56.842196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:56.842482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:56.842761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:56.843590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=32d47ecc05fc4bf9909316ef7edb0409, user.id=f2d1aa264a5b4e0598403f584924b26b) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:44:56.843902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:56.845356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e643c0d-48fd-422f-8adc-8fcd34bbeaee None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:56.851108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 550/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:44:56 2022] GET /identity/v3/role_assignments?user.id=f2d1aa264a5b4e0598403f584924b26b&scope.project.id=32d47ecc05fc4bf9909316ef7edb0409&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:59.101974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d57fc-87de-4c4e-91d0-a4c0ba119180 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:59.102521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d57fc-87de-4c4e-91d0-a4c0ba119180 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:59.102615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d57fc-87de-4c4e-91d0-a4c0ba119180 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:59.103950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 557/1107] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:44:59.109253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:59.109674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:59.109813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:59.126507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:44:59.127711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:44:59.192933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 551/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:44:59.217481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d57fc-87de-4c4e-91d0-a4c0ba119180 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:59.316405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d57fc-87de-4c4e-91d0-a4c0ba119180 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:59.343064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:59.350438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:59.351226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:59.351515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:59.358051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:59.358051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:59.358051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d6700-73f9-4763-8895-2222529bcf73 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:59.358051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 558/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:44:59.361846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:44:59.459969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1b3b-0432-43b0-b143-f293a964e6e4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:44:59.469004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:44:59.492588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:44:59.493252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:44:59.493534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:44:59.493806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:44:59.494537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:44:59.496016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bbdb0-04c7-482b-b74c-edbd33a1eb0e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:44:59.599421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 552/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:44:59 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:01.884328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534e18-dfc6-4057-b4e3-c1afc941eceb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:01.884844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534e18-dfc6-4057-b4e3-c1afc941eceb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:01.884931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41534e18-dfc6-4057-b4e3-c1afc941eceb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:01.886281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 559/1111] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:45:01.891484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:01.891860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:01.892048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:01.908653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:01.909863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:01.974478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 553/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:01.998369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41534e18-dfc6-4057-b4e3-c1afc941eceb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:02.096167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41534e18-dfc6-4057-b4e3-c1afc941eceb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:02.130058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:02.130913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:02.131198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:02.131476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] PATH_INFO: `/v3/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:02.132948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] RBAC: Authorizing `identity:get_role(role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:02.134332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:02.135709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 560/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:01 2022] GET /identity/v3/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:02.141476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:02.231861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:02.238774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5bcba-c8b9-4e54-beaa-531b97db3837 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:02.270933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:02.271846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:02.272330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:02.272666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] PATH_INFO: `/v3/users/c5769c1d6a134d03a8b89ee6a1464d21` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:02.286562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] RBAC: Authorizing `identity:get_user(user_id=c5769c1d6a134d03a8b89ee6a1464d21)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:02.288014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:02.289702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 554/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:02 2022] GET /identity/v3/users/c5769c1d6a134d03a8b89ee6a1464d21 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:02.295474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:02.357762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:02.394295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce74eb-9080-45e0-802a-2038103b7859 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:02.428046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:02.428684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:02.428967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:02.429242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:02.493460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:02.494936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:02.551891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:02.588163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 561/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:02.594196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:02.691982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c255c-d479-4787-bc0c-ebf159903e68 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:02.725633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:02.726531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:02.726817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:02.727096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:02.728289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:02.729731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68578c7d-25ca-4c49-8586-5de9ebd3ee2e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:02.731483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 555/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:02 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:02.737580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:02.832577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1256a7-372d-4d80-ad4a-c3e6269b77bd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:02.866318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:02.866957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:02.867236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:02.867507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:02.868328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=32d47ecc05fc4bf9909316ef7edb0409, user.id=c5769c1d6a134d03a8b89ee6a1464d21) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:02.868636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:02.870115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46643-7a22-4648-91a7-67a525d85c13 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:02.875375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 562/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:02 2022] GET /identity/v3/role_assignments?user.id=c5769c1d6a134d03a8b89ee6a1464d21&scope.project.id=32d47ecc05fc4bf9909316ef7edb0409&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:05.069803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f9c6-72ad-4e2d-aa63-972e38127c2b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.070338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f9c6-72ad-4e2d-aa63-972e38127c2b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.070338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f9c6-72ad-4e2d-aa63-972e38127c2b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.071688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 556/1118] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:05.077235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.077630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.077775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.093910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:05.095087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:05.117309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:05.160653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 563/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:05.183542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f9c6-72ad-4e2d-aa63-972e38127c2b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:05.205274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:05.282506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f9c6-72ad-4e2d-aa63-972e38127c2b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:05.316283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:05.317139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.317422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.317697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] PATH_INFO: `/v3/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.319195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] RBAC: Authorizing `identity:get_role(role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:05.320650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:05.321993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 557/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:05 2022] GET /identity/v3/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:05.327922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:05.421983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6d19b-f291-4e20-a4a3-cb1ba5f71f0f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:05.454619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:05.455478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.455756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.456581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] PATH_INFO: `/v3/users/c5769c1d6a134d03a8b89ee6a1464d21` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.457766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c5769c1d6a134d03a8b89ee6a1464d21)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:05.459224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:05.460840 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 564/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:05 2022] GET /identity/v3/users/c5769c1d6a134d03a8b89ee6a1464d21 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:05.466601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:05.552376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:05.564028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12a19b-e7a0-448b-8b71-2b43d823fb02 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:05.598263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:05.599050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.599329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.599602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.600857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:05.602300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d191e-b23e-44e4-8d0b-68a8ce9954e0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:05.603969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 558/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:05 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:05.610040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:05.637732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:05.707202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf968-b2e4-43ae-bb13-f30d0c1741e1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:05.739759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:05.740630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:05.740909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:05.741180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409/users/c5769c1d6a134d03a8b89ee6a1464d21/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:05.743352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] RBAC: Authorizing `identity:create_grant(project_id=32d47ecc05fc4bf9909316ef7edb0409, user_id=c5769c1d6a134d03a8b89ee6a1464d21, role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:05.744769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59d8e1-9863-4723-aadc-b9c732baaf2d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:05.833563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 565/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:45:05 2022] PUT /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409/users/c5769c1d6a134d03a8b89ee6a1464d21/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:45:08.048030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576166e-7197-41a2-b585-e153f90cb66a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.048535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576166e-7197-41a2-b585-e153f90cb66a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.048535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576166e-7197-41a2-b585-e153f90cb66a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.050395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 559/1124] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:08.056050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.056438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.056613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.073579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:08.074805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:08.138480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 566/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:08.162009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576166e-7197-41a2-b585-e153f90cb66a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:08.261907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576166e-7197-41a2-b585-e153f90cb66a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:08.294947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:08.295804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.296088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.296365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] PATH_INFO: `/v3/roles/a77dbdc67106419e9a6664e44d8fa458` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.297877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] RBAC: Authorizing `identity:get_role(role_id=a77dbdc67106419e9a6664e44d8fa458)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:08.299311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:08.301209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 560/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:08 2022] GET /identity/v3/roles/a77dbdc67106419e9a6664e44d8fa458 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:08.307162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:08.324345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:08.402772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd993db-0e73-4867-b5db-4e885b6a4cf7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:08.436675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:08.437533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.437806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.438096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] PATH_INFO: `/v3/users/c5769c1d6a134d03a8b89ee6a1464d21` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.439266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] RBAC: Authorizing `identity:get_user(user_id=c5769c1d6a134d03a8b89ee6a1464d21)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:08.440732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:08.442368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 567/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:08 2022] GET /identity/v3/users/c5769c1d6a134d03a8b89ee6a1464d21 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:08.448138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:08.473017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:08.544841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724ab1-2ad1-4bd9-99d7-7f15d5055375 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:08.577636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:08.578248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.578526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.578802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.643954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:08.645388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:08.668575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:08.740128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 561/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:08.746101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:08.827462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:08.843015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824348-d6aa-4f06-b56e-af9632f3507e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:08.876673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:08.877575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:08.877860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:08.878175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] PATH_INFO: `/v3/projects/32d47ecc05fc4bf9909316ef7edb0409` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:08.879389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] RBAC: Authorizing `identity:get_project(project_id=32d47ecc05fc4bf9909316ef7edb0409)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:08.880832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c31e81-1c2b-4729-9c9e-f5894fbb7fca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:08.882586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 568/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:08 2022] GET /identity/v3/projects/32d47ecc05fc4bf9909316ef7edb0409 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:08.888870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:08.985460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278739-ef18-43f4-824f-94b2e1ccb58e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:09.009107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:09.019968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] RBAC: Adding query filter params (role.id=a77dbdc67106419e9a6664e44d8fa458, scope.project.id=32d47ecc05fc4bf9909316ef7edb0409, user.id=c5769c1d6a134d03a8b89ee6a1464d21) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:09.024019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dce1c-012e-4617-b8b8-020f2bb3de9b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:09.029416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 562/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:08 2022] GET /identity/v3/role_assignments?user.id=c5769c1d6a134d03a8b89ee6a1464d21&scope.project.id=32d47ecc05fc4bf9909316ef7edb0409&role.id=a77dbdc67106419e9a6664e44d8fa458 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:11.272289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953534b-58c1-4cf2-8c6d-28490a7fd74f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:11.272857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953534b-58c1-4cf2-8c6d-28490a7fd74f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:11.272857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953534b-58c1-4cf2-8c6d-28490a7fd74f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:11.274268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 569/1131] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:11.279351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:11.279719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:11.279906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:11.297002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:11.298265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:11.363860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 563/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:11.388039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953534b-58c1-4cf2-8c6d-28490a7fd74f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:11.485428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953534b-58c1-4cf2-8c6d-28490a7fd74f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:11.518729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:11.519511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:11.519795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:11.520069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:11.521237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:11.522730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bceac-4267-472f-85b6-b47766ca7aee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:11.524282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 570/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:11.530092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:11.625296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2655-5fa4-455e-a38e-ead339ab114f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:11.642152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:11.658155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:11.658821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:11.659100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:11.659378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:11.660096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:11.661539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dfa66-0e24-4577-8d05-ac5cf3e09e03 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:11.786400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 564/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:45:11 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:14.066709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121dd56-bdf7-4f0d-bf60-2bf58f0397b2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:14.067268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121dd56-bdf7-4f0d-bf60-2bf58f0397b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:14.067268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121dd56-bdf7-4f0d-bf60-2bf58f0397b2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:14.068559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 571/1135] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:14.073827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:14.074294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:14.074394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:14.091390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:14.092586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:14.156730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 565/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:14.182195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121dd56-bdf7-4f0d-bf60-2bf58f0397b2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:14.203425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:14.280945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121dd56-bdf7-4f0d-bf60-2bf58f0397b2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:14.316868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:14.317579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:14.317861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:14.318236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:14.319412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:14.320855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b470e-68b0-4c24-868c-b52c3ded55c3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:14.322499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 572/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:14.328219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:14.421368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:14.424165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6df58-d0b0-4833-ab0b-a197a9050db1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:14.457437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:14.458297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:14.458584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:14.458860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:14.459579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:14.460996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b210b-2a35-4a91-89b4-0d8724339b25 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:14.558391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 566/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:45:14 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:16.846735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b1dd-e0bd-478a-9be1-e89adc36428b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:16.847267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b1dd-e0bd-478a-9be1-e89adc36428b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:16.847267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b1dd-e0bd-478a-9be1-e89adc36428b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:16.848648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 573/1139] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:16.853870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:16.854377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:16.854476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:16.871935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:16.873124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:16.938776 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 567/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:16.962324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b1dd-e0bd-478a-9be1-e89adc36428b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.048311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:17.060426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b1dd-e0bd-478a-9be1-e89adc36428b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:17.092653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:17.093436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:17.093723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:17.094029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:17.104933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:17.112651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:17.114140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:17.115407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 574/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:17.120150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.200705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:17.222726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd82f6-6de7-470e-b744-ba8f971ae805 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:17.256079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:17.256738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:17.257018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:17.257288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:17.258061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:17.258365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:17.259740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:17.268065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 568/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:17.274017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.375770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347513a-3def-4fe6-b9fc-12092b6ecd09 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:17.408671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:17.409536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:17.409824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:17.410130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] PATH_INFO: `/v3/users/dca5fbb1dea147a68d5c0520eada2113` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:17.423036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] RBAC: Authorizing `identity:get_user(user_id=dca5fbb1dea147a68d5c0520eada2113)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:17.424504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:17.426204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 575/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:17 2022] GET /identity/v3/users/dca5fbb1dea147a68d5c0520eada2113 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:17.431994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.530253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0be23f-22d5-4782-a3ec-ba7a49cc97f6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:17.564286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:17.564932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:17.565214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:17.565512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:17.582510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:17.631189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:17.632571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:17.728803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 569/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:17.734664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.743635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:17.832045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ea13-0e2c-4c1e-ab74-9b1cd446fd27 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:17.864792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:17.865636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:17.865938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:17.866212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] PATH_INFO: `/v3/projects/738d5a59d1c246cdbaf74d65efba54d3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:17.867371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] RBAC: Authorizing `identity:get_project(project_id=738d5a59d1c246cdbaf74d65efba54d3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:17.868821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397d303-a5e7-4f4b-85c6-a920ceab4150 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:17.870547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 576/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:17 2022] GET /identity/v3/projects/738d5a59d1c246cdbaf74d65efba54d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:17.876681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:17.924405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:17.974313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b283398-c49b-428d-b0b5-eac289f6743f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:18.007263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:18.007910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:18.008189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:18.008462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:18.009283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=738d5a59d1c246cdbaf74d65efba54d3, user.id=dca5fbb1dea147a68d5c0520eada2113) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:18.009591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:18.011028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba5cb-c98d-494f-8740-3f09b9991674 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:18.016395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 570/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:17 2022] GET /identity/v3/role_assignments?user.id=dca5fbb1dea147a68d5c0520eada2113&scope.project.id=738d5a59d1c246cdbaf74d65efba54d3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:20.215116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45010-2d6c-4309-9563-2518cbed326f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.215682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45010-2d6c-4309-9563-2518cbed326f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.215682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45010-2d6c-4309-9563-2518cbed326f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.217028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 577/1147] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:20.222943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.223344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.223501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.240672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:20.241850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:20.306830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 571/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:20.330687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45010-2d6c-4309-9563-2518cbed326f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:20.404548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:20.429675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45010-2d6c-4309-9563-2518cbed326f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:20.463313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:20.464094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.464379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.464658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.474615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:20.482201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:20.483113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:20.483971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 578/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:20.489876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:20.532070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:20.586917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429a50-67c9-42b9-a3eb-d68665c94ebe None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:20.620807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:20.621481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.621768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.622086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.622846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:20.623153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:20.624522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:20.633332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 572/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:20.639460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:20.736951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979b320-64c2-4410-b36f-3a989611a79c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:20.769349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:20.770240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.770524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.770798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] PATH_INFO: `/v3/users/dca5fbb1dea147a68d5c0520eada2113` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.771983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] RBAC: Authorizing `identity:get_user(user_id=dca5fbb1dea147a68d5c0520eada2113)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:20.773424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:20.775241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 579/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:20 2022] GET /identity/v3/users/dca5fbb1dea147a68d5c0520eada2113 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:20.781142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:20.881240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd67dd-d7b9-45fd-839b-8688bcaf7e82 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:20.883584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:20.915483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:20.916346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:20.916625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:20.916900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] PATH_INFO: `/v3/projects/738d5a59d1c246cdbaf74d65efba54d3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:20.918095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] RBAC: Authorizing `identity:get_project(project_id=738d5a59d1c246cdbaf74d65efba54d3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:20.919513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15757e79-3f0f-4046-aa24-48c3ee894321 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:20.921205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 573/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:20 2022] GET /identity/v3/projects/738d5a59d1c246cdbaf74d65efba54d3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:20.927302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:20.930848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:21.026712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9012-e661-4e37-9dc6-63d36057d490 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:21.058695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:21.059629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:21.059911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:21.060190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] PATH_INFO: `/v3/projects/738d5a59d1c246cdbaf74d65efba54d3/users/dca5fbb1dea147a68d5c0520eada2113/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:21.062155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] RBAC: Authorizing `identity:create_grant(project_id=738d5a59d1c246cdbaf74d65efba54d3, user_id=dca5fbb1dea147a68d5c0520eada2113, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:21.063589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952cd99-96a1-440a-b985-961ed9ebd793 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:21.195860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 580/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:45:20 2022] PUT /identity/v3/projects/738d5a59d1c246cdbaf74d65efba54d3/users/dca5fbb1dea147a68d5c0520eada2113/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:45:23.424423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976424ec-8aee-4070-b5f8-8430f31d0d7a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:23.424958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976424ec-8aee-4070-b5f8-8430f31d0d7a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:23.424958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976424ec-8aee-4070-b5f8-8430f31d0d7a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:23.426390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 574/1154] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:23.431602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:23.432024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:23.432171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:23.448968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:23.450203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:23.504153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:23.514057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 581/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:23.538624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976424ec-8aee-4070-b5f8-8430f31d0d7a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:23.638731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976424ec-8aee-4070-b5f8-8430f31d0d7a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:23.671476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:23.672267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:23.672552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:23.672872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:23.683394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:23.691718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:23.692648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:45:23.693682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 575/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:23.699907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:23.795161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cae23-3ae2-48c9-8b64-041a120e871c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:23.829652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:23.830351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:23.830640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:23.830919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:23.831676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:23.831986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:23.833405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:23.841421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 582/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:23.847246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:23.879788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:23.945714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b2a0-d1b7-47b6-b407-8db4d886907e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:23.978410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:23.979309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:23.979588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:23.979859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] PATH_INFO: `/v3/users/dca5fbb1dea147a68d5c0520eada2113` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:23.981026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] RBAC: Authorizing `identity:get_user(user_id=dca5fbb1dea147a68d5c0520eada2113)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:23.982472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:23.984128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 576/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:23 2022] GET /identity/v3/users/dca5fbb1dea147a68d5c0520eada2113 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:23.990731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:24.044167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:24.086997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac900d-39ac-4784-a6ce-778e3383f6e1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:24.120231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:24.120872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:24.121151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:24.121425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:24.185415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:24.186884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:24.237726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:24.279504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 583/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:24.285921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:24.380844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:24.383592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f421b7-37df-4733-9214-879c3edfcad4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:24.416542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:24.417397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:24.417681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:24.417986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] PATH_INFO: `/v3/projects/738d5a59d1c246cdbaf74d65efba54d3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:24.419149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] RBAC: Authorizing `identity:get_project(project_id=738d5a59d1c246cdbaf74d65efba54d3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:24.420570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529f3b-489b-4025-b20c-dd07709181b9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:24.422283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 577/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:24 2022] GET /identity/v3/projects/738d5a59d1c246cdbaf74d65efba54d3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:24.429530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:24.525948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4756c-bd06-495c-accf-24a3cea1242e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:24.558486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:24.559135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:24.559417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:24.559694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:24.560523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=738d5a59d1c246cdbaf74d65efba54d3, user.id=dca5fbb1dea147a68d5c0520eada2113) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:24.560836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:24.562284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b314e-ac65-4c52-bbc7-d7c34944c03e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:24.568623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 584/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:24 2022] GET /identity/v3/role_assignments?user.id=dca5fbb1dea147a68d5c0520eada2113&scope.project.id=738d5a59d1c246cdbaf74d65efba54d3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:26.818197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b7f2-39f4-4c11-8a72-97057c0c6d5e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:26.818741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b7f2-39f4-4c11-8a72-97057c0c6d5e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:26.818741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b7f2-39f4-4c11-8a72-97057c0c6d5e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:26.820130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 578/1162] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:26.825384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:26.825769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:26.825966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:26.842845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:26.844025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:26.857466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:26.910530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 585/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:26.933808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6b7f2-39f4-4c11-8a72-97057c0c6d5e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:27.033456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6b7f2-39f4-4c11-8a72-97057c0c6d5e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:27.066146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:27.066719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:27.067002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:27.067277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:27.100559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:27.133671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:27.135748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:27.232742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 579/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:27.239094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:27.335781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4430f-edce-486c-9174-71587b989b79 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:27.369018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:27.369815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:27.370126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:27.370402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:27.377409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:27.378921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-51e376d5-37b8-474f-b2bb-957a8512f477 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:27.392659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:27.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:27.395184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 586/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:45:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:27.399906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:27.463535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:27.495352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02766df9-ace4-4e56-9e8e-d57e9983b30f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:27.528135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:27.528793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:27.529075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:27.529349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:27.530089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:27.530396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:27.531763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b93e-5718-4607-bfcf-2201b45080e0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:27.538876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 580/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Tue May 31 20:45:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:29.754516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d484-a971-4699-af74-be64f8b7c5f8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:29.755091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d484-a971-4699-af74-be64f8b7c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:29.755091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d484-a971-4699-af74-be64f8b7c5f8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:29.756479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 587/1167] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:29.761781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d033-17ae-4d50-a399-570a87cf97e3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:29.762234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d033-17ae-4d50-a399-570a87cf97e3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:29.762391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d033-17ae-4d50-a399-570a87cf97e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:29.779514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f130d033-17ae-4d50-a399-570a87cf97e3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:29.780728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f130d033-17ae-4d50-a399-570a87cf97e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:29.847423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 581/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:29.870466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43d484-a971-4699-af74-be64f8b7c5f8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:29.881912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:29.971404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43d484-a971-4699-af74-be64f8b7c5f8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:30.003466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:30.004109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:30.004391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:30.004714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:30.005397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:30.006777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04385-6781-4774-a628-bd3a6ba52820 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:30.084880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 588/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Tue May 31 20:45:29 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:32.343681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fda2-a07c-4842-801f-3bae6e1eb309 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:32.344230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fda2-a07c-4842-801f-3bae6e1eb309 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:32.344230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267fda2-a07c-4842-801f-3bae6e1eb309 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:32.345660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 582/1170] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:32.351005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:32.351433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:32.351558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:32.368164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:32.369345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:32.428414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:32.433681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 589/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:32.458458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267fda2-a07c-4842-801f-3bae6e1eb309 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:32.519381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:32.557678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267fda2-a07c-4842-801f-3bae6e1eb309 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:32.591654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:32.592520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:32.592801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:32.593075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] PATH_INFO: `/v3/domains/0a79dba513ba49b19a0348e7ca65f35d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:32.603471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0a79dba513ba49b19a0348e7ca65f35d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:32.604855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58d714-c50e-4c4f-9315-67ff4997d4d5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:32.606527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 583/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 31 20:45:32 2022] GET /identity/v3/domains/0a79dba513ba49b19a0348e7ca65f35d => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:32.613164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:32.707578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9464b52-fcbd-4704-ab50-a7f9eefa9b47 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:32.740791 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:32.741440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:32.741726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:32.742031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:32.742742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:32.744183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcfa8b-df5b-40a4-989b-2892f683185a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:32.826648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 590/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:45:32 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:35.090883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d643-d422-4229-91ba-5f974ee44bf9 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:35.091386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d643-d422-4229-91ba-5f974ee44bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:35.091386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d643-d422-4229-91ba-5f974ee44bf9 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:35.092765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 584/1174] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:35.097986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:35.098351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:35.098547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:35.115578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:35.116746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:35.160515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:35.180203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 591/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:35.205120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115d643-d422-4229-91ba-5f974ee44bf9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:35.306317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115d643-d422-4229-91ba-5f974ee44bf9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:35.329063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:35.340193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:35.342724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:35.342724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:35.342724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] PATH_INFO: `/v3/domains/0a79dba513ba49b19a0348e7ca65f35d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:35.342724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0a79dba513ba49b19a0348e7ca65f35d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:35.344683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00cb3-310f-4f98-9b67-dd724c306460 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:35.346351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 585/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Tue May 31 20:45:35 2022] GET /identity/v3/domains/0a79dba513ba49b19a0348e7ca65f35d => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:35.352118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:35.448533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c0787-0e78-44ad-9762-bc4aaf7674fd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:35.482220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:35.482890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:35.483171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:35.483443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:35.484150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:35.486196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b529ba-d586-4ce7-9636-61fc85acccba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:35.582541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 592/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:45:35 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:45:37.865578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7dac-ff27-477e-9439-44e5d8f18c94 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:37.866151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7dac-ff27-477e-9439-44e5d8f18c94 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:37.866151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc7dac-ff27-477e-9439-44e5d8f18c94 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:37.867562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 586/1178] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:37.872914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:37.873297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:37.873478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:37.890132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:37.891836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:37.920284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:37.956966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 593/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:37.981048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc7dac-ff27-477e-9439-44e5d8f18c94 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.078887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc7dac-ff27-477e-9439-44e5d8f18c94 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:38.111674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:38.112700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:38.112986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:38.113264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:38.123131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:38.131500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:38.132580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:45:38.133692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 587/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:38.138786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.234335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e988491-a21c-4418-a7b7-d473105373b8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:38.269349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:38.270046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:38.270330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:38.270603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:38.271355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:38.271659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:38.273010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:38.281106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 594/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:38.287055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.338549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:38.387201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2e4d-f966-465a-9dca-7790fffb58d6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:38.419353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:38.420217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:38.420493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:38.420761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] PATH_INFO: `/v3/users/cfcb352a69d5420796d60c7e088e1c5c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:38.433297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cfcb352a69d5420796d60c7e088e1c5c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:38.434744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:38.436362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 588/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:38 2022] GET /identity/v3/users/cfcb352a69d5420796d60c7e088e1c5c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:38.442800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.471120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:38.540279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0b88-52b6-4b18-8b37-728de843b1a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:38.572781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:38.573429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:38.573715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:38.574030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:38.639250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:38.641195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:38.666930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:38.736345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 595/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:45:38.742669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.840329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3ad7f-078b-4fcc-8680-f9c333e3bfc0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:38.850043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:38.873522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:38.874407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:38.874689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:38.874985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] PATH_INFO: `/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:38.876168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a69e1fe2d346c28fa9dea3eb811016)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:38.877585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b99320-2e1a-4037-a6ff-2e021e815313 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:38.879301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 589/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:38 2022] GET /identity/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:38.885584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:38.982997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939824c-cce9-4e7a-a8e5-af9e98bbe7d2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:39.008155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:39.015561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=d0a69e1fe2d346c28fa9dea3eb811016, user.id=cfcb352a69d5420796d60c7e088e1c5c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:39.035884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dfc81-649a-4c73-b128-05c52e229157 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:39.036425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 596/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:38 2022] GET /identity/v3/role_assignments?user.id=cfcb352a69d5420796d60c7e088e1c5c&scope.project.id=d0a69e1fe2d346c28fa9dea3eb811016&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:41.240875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada46-e0e2-4a88-944e-0e854d8302ca None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.241405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada46-e0e2-4a88-944e-0e854d8302ca None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.241405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ada46-e0e2-4a88-944e-0e854d8302ca None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.242811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 590/1186] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:41.247936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.248311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.248498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.264776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:41.265994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:41.331220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 597/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:41.354146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ada46-e0e2-4a88-944e-0e854d8302ca None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:41.451340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ada46-e0e2-4a88-944e-0e854d8302ca None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:41.483610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:41.485007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.485285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.485557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.495693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:41.503421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:41.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:45:41.505192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 591/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:41.510700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:41.604964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7afced-b77b-4995-ac32-9f943b110ea5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:41.627949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:41.639037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:41.642178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.642178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.642178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.642178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:41.642178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:41.643221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:41.651088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 598/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:41.657615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:41.691441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:41.753204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da059430-53b0-4058-80f4-16a5a0952e3b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:41.786348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:41.787265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.787537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.787807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] PATH_INFO: `/v3/users/cfcb352a69d5420796d60c7e088e1c5c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.789008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cfcb352a69d5420796d60c7e088e1c5c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:41.790465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:41.792092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 592/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:41 2022] GET /identity/v3/users/cfcb352a69d5420796d60c7e088e1c5c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:41.797779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:41.895680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c56a6-b268-47bd-9faa-3b362e2b52c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:41.927976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:41.928825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:41.929101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:41.929371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] PATH_INFO: `/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:41.930561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a69e1fe2d346c28fa9dea3eb811016)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:41.931988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da814a2-efc0-40d2-ad05-ae8fa71124e3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:41.933668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 599/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:41 2022] GET /identity/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:41.939674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:42.037020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92cf7f-a999-4575-a055-c75a67f681d1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:42.039348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:42.069565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:42.070483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:42.070769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:42.071045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] PATH_INFO: `/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016/users/cfcb352a69d5420796d60c7e088e1c5c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:42.072984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0a69e1fe2d346c28fa9dea3eb811016, user_id=cfcb352a69d5420796d60c7e088e1c5c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:42.074761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e3dbf-601e-4701-a8ac-26ec06be03e2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:42.149747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 593/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:45:41 2022] PUT /identity/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016/users/cfcb352a69d5420796d60c7e088e1c5c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:45:44.362147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7aa18-79a2-4747-940f-8887dcfe257c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:44.362679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7aa18-79a2-4747-940f-8887dcfe257c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:44.362679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7aa18-79a2-4747-940f-8887dcfe257c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:44.364063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 600/1193] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:45:44.369214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:44.369636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:44.369777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:44.386720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:45:44.387900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:45:44.455435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 594/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:45:44.481256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7aa18-79a2-4747-940f-8887dcfe257c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:44.533992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:44.578633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7aa18-79a2-4747-940f-8887dcfe257c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:44.611254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:44.612327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:44.612551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:44.612818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:44.622409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:45:44.629914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:45:44.631089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:45:44.632039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 601/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:45:44.637129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:44.726645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:44.733075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01405f-e5bf-4b37-bb80-aec07d8fdd8e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:44.765752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:44.766432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:44.766920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:44.767358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:44.768151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:44.768789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:44.770223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:44.778117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 595/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:44.784586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:44.882115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e69cf-8d92-4ad6-88af-ff8194fad3ec None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:44.895068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:44.914906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:44.915779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:44.916061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:44.916337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] PATH_INFO: `/v3/users/cfcb352a69d5420796d60c7e088e1c5c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:44.917565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cfcb352a69d5420796d60c7e088e1c5c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:44.918988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:44.920622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 602/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Tue May 31 20:45:44 2022] GET /identity/v3/users/cfcb352a69d5420796d60c7e088e1c5c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:44.926578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:45.025442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1229ad-0e5e-44f3-aafc-0649c13eff6c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:45.057117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:45.057779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:45.058087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:45.058365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:45.083494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:45.125094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:45.126597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:45.220949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 596/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:45:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:45:45.227102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:45.323842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af129e-2e7f-4cff-9c8b-accb5156d9a7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:45.355971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:45.356823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:45.357104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:45.357379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] PATH_INFO: `/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:45.358552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=d0a69e1fe2d346c28fa9dea3eb811016)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:45.360509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f1e4e-6439-4960-beb2-b0f1ab616ae1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:45.362487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 603/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Tue May 31 20:45:45 2022] GET /identity/v3/projects/d0a69e1fe2d346c28fa9dea3eb811016 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:45.368697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:45:45.422765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:45.464911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c24e7b-7717-47ee-adeb-7feca8c3a369 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:45:45.498281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:45:45.498852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:45:45.499131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:45:45.499414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:45:45.500769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=d0a69e1fe2d346c28fa9dea3eb811016, user.id=cfcb352a69d5420796d60c7e088e1c5c) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:45:45.501076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:45:45.502678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817816c-0f69-4f14-873c-5415d067cc15 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:45:45.508465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 597/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:45:45 2022] GET /identity/v3/role_assignments?user.id=cfcb352a69d5420796d60c7e088e1c5c&scope.project.id=d0a69e1fe2d346c28fa9dea3eb811016&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:45:55.351899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=76 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:45:55.505741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=40 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:07.408042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf549-dd01-44d8-a786-6feabb89fdb5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:07.408912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf549-dd01-44d8-a786-6feabb89fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:07.408912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf549-dd01-44d8-a786-6feabb89fdb5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:07.410541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 604/1201] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:07.416468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:07.417040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:07.417190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:07.436152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:07.437355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:07.510680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 598/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:07.536808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf549-dd01-44d8-a786-6feabb89fdb5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:07.643750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf549-dd01-44d8-a786-6feabb89fdb5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:07.680935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:07.681764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:07.682092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:07.682374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:07.693399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:07.694904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:07.713748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:07.715016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:07.716216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:07.716216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:07.716216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:07.716216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:07.716216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 605/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:07.721462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:07.825485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68d966-40f4-465c-aae2-18849e8bcd65 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:07.857357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:07.863580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:07.864259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:07.864546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:07.864829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:07.865561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:07.865871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:07.867289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6644827-e1c7-4879-a478-6deedcc1b6f7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:07.878609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 599/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:07.885095 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:07.943966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:07.990862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893b483-f406-4e2c-bf5f-d585a18a315f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:08.024088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:08.024757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:08.025037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:08.025309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:08.026048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:08.027520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045761f-bf7d-40b3-8f02-763bf057e865 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:08.146235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 606/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Tue May 31 20:47:07 2022] POST /identity/v3/users => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:47:10.433205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460db-a6be-4571-ac47-46f7ab3c02ee None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:10.433782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460db-a6be-4571-ac47-46f7ab3c02ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:10.433782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460db-a6be-4571-ac47-46f7ab3c02ee None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:10.435158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 600/1206] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:10.440369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:10.440798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:10.441207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:10.458925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:10.460136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:10.527988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 607/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:10.552276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d460db-a6be-4571-ac47-46f7ab3c02ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:10.660889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d460db-a6be-4571-ac47-46f7ab3c02ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:10.696402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:10.697184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:10.697529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:10.697854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:10.709091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:10.717086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:10.718209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:10.719067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 601/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:47:10.725224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:10.772275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:10.834061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29680bb-2d82-4a2d-a5c7-4136657f3fd6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:10.872719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:10.873536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:10.873871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:10.874196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:10.875014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:10.875339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:10.876812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:10.886585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 608/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:10.892921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:10.946259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:10.997727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b9a19-b896-4d5e-b97f-4f89a4d9c3c6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:11.031389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:11.032233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:11.032529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:11.033050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:11.045789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:11.047284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:11.065481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:11.069473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:11.070713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:11.070713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:11.070713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:11.070713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:11.070713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 602/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:11.073387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:11.175092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:11.179140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657eda7-2227-4ba1-bdfd-067ece2fec48 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:11.213602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:11.214342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:11.214612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:11.214889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:11.215622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:11.215933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:11.217308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:11.229629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 609/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:47:11.235775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:11.340644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38323-1ab2-4b8b-a062-8ee719e8998d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:11.342195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:11.377199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:11.378032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:11.378314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:11.378587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:11.386275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:11.387796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:11.403466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:11.411368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:11.413341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 603/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:47:11.414761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:11.526086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac9074-0e1b-48c3-89a2-2d0651d2b487 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:11.564899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:11.565612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:11.565930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:11.566205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:11.567209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:11.567522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:11.569103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:11.591582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 610/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:11.598607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:11.712931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2862ca-2ae2-46d5-aff6-2f1b0fd9ccf4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:11.747903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:11.748565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:11.748852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:11.749133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:11.780566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:11.820967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:11.822511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:11.929628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 604/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:47:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:47:11.935535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:11.954937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:12.034728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14a1cf-acdd-42d2-b6c4-039c29e2cd5f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:12.068535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:12.069328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:12.069613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:12.069888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:12.080744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:12.082834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:12.101322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:12.103083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:12.104977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:12.104977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:12.104977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:12.104977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:12.106073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 611/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:12.108465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:12.171932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:12.214921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f267c29-d60a-4140-9870-ac96e13119ca None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:12.249260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:12.250082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:12.250372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:12.250656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:12.251397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:12.251703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:12.253084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:12.267840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 605/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:12.274260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:12.347774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:12.380388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a2da-4baa-46f5-8273-bd02fcb617f0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:12.413919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:12.414739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:12.415020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:12.415362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:12.422598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:12.424039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:12.438674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:12.439804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:12.440759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 612/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:12.447041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:12.549766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8a9d2-0e20-4d7e-9a07-2dc08cf69c3a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:12.575379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:12.587178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:12.587879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:12.588166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:12.588447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:12.589240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:12.589554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:12.591011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7823e9-3911-47bc-b273-75810bec7a03 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:12.604048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 606/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:47:12.610844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:12.715804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676fe91-918c-44c5-9216-97710651b5b3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:12.746249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:12.752275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:12.753010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:12.753293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:12.753573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:12.754487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=a8b4d719ef17413e8f7c69f84348851a) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:12.754806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:12.756276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a61ff-65de-460c-be20-0d7d6d6ac7d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:12.764833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 613/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:47:12 2022] GET /identity/v3/role_assignments?user.id=a8b4d719ef17413e8f7c69f84348851a&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:15.052072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0478ea-a429-4b1e-aa60-015beaee22c2 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.052584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0478ea-a429-4b1e-aa60-015beaee22c2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.052584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0478ea-a429-4b1e-aa60-015beaee22c2 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.054044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 607/1220] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:15.059283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.066673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.066673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.076486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:15.077676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:15.144516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 614/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:15.168005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0478ea-a429-4b1e-aa60-015beaee22c2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:15.270596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0478ea-a429-4b1e-aa60-015beaee22c2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:15.304078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:15.304865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.305146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.305481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.315341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:15.323118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:15.329076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:15.330135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 608/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:15.330935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:15.426676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dfe69-59db-4a8e-8f4c-1e47a36df591 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:15.449792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:15.461083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:15.461758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.462075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.462350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.463127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:15.463572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:15.464865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:15.473655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 615/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:15.479741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:15.523615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:15.578858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ca462-a2b9-4193-802e-68873d54d867 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:15.612248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:15.613044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.613326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.613600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.624290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:15.625751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:15.643230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:15.644427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:15.646181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:15.646181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:15.646181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:15.646181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:15.646181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 609/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:15.650819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:15.750361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04713097-8fd9-498b-afb2-a134d356d6a1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:15.783659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:15.784328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.784608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.784880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.785635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:15.785967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:15.787344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:15.799220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 616/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:15.804974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:15.899135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:15.905998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3ffa-f35d-4cad-98ab-021b7d380639 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:15.939576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:15.940381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:15.940666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:15.940967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:15.948743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:15.950308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:15.965015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:15.966287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:15.967425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 610/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:15.972151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.018806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:16.069946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e906c-6486-4d25-b372-037c18a8baca None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.102682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.103357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.103643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.103950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.104759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:16.105069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.106532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:16.123908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 617/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:16.130244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.227467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f08a9-3eb4-497a-916a-c1afa282acc0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.262044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.262880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.263172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.263453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.274109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.275908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:16.293992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:16.295127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:16.296150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:16.296150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:16.296150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:16.296150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:16.296150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 611/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:16.301101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.401915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d26121-5490-4c7f-ab5c-d95ba3d23ef1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.404293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:16.435269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.435935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.436212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.436615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.437396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:16.438199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.439556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:16.453013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 618/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:16.459525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.468786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:16.560832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333ef25-a6fb-4ab6-b1e8-3af82cf8a9ba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.596424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.597226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.597505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.597777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.605626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.607149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:16.621496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:16.622885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:16.624298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 612/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:16.628687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.727010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1edc72-a744-444a-a01c-b076c83a5962 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.760599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.761306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.761593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.761873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.762690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:16.763000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.764419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a611b-7742-421e-a5d2-54127abcf351 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:16.776111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 619/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:16.782370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:16.851637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:16.885595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fac41-a294-4517-ada9-c696ff1bc345 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:16.916911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:16.917793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:16.918103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:16.918380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/a8b4d719ef17413e8f7c69f84348851a/roles/576c3ae6c0174ec0ac84969b5881c954` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:16.932439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=a8b4d719ef17413e8f7c69f84348851a, role_id=576c3ae6c0174ec0ac84969b5881c954)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:16.934017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e11c2d-0124-49c7-8e28-4a0befb288d0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:17.089219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 613/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:47:16 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/a8b4d719ef17413e8f7c69f84348851a/roles/576c3ae6c0174ec0ac84969b5881c954 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:47:19.334327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2781b-0304-406f-8a1f-c0603507933c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:19.334861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2781b-0304-406f-8a1f-c0603507933c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:19.334861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2781b-0304-406f-8a1f-c0603507933c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:19.336233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 620/1233] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:19.341563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:19.342093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:19.342234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:19.358537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:19.359732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:19.426549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 614/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:19.450406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2781b-0304-406f-8a1f-c0603507933c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:19.476238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:19.549465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2781b-0304-406f-8a1f-c0603507933c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:19.582298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:19.583696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:19.583976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:19.584250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:19.594025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:19.601795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:19.602896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:19.603764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 621/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Tue May 31 20:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:47:19.611292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:19.657050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:19.710839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003755c-0c74-42b6-a149-0a6db3112c9f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:19.744021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:19.744770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:19.745061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:19.745389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:19.746129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:19.746435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:19.747801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:19.756222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 615/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Tue May 31 20:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:19.762029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:19.845693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:19.861079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31611ddc-bca8-47f1-9e4c-c9cb984934a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:19.893627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:19.894752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:19.894752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:19.894941 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:19.904980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:19.906449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:19.923018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:19.924435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:19.926176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:19.926176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:19.926176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:19.926176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:19.926176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 622/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:19.930756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.028677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0faa-fa9d-4791-ab5f-ac94be61491d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:20.037753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:20.061641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:20.062336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:20.062617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:20.062892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:20.063610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:20.063913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:20.065264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:20.077558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 616/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:20.083398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.184022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5221bf5-691f-4414-9a45-7c7f6c805afd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:20.217170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:20.217998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:20.218288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:20.218638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:20.221312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:20.226813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:20.228245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:20.243301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:20.244360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:20.245477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 623/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:20.250403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.349843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99c564-4c46-495c-ad78-a29b05100011 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:20.384124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:20.384888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:20.385176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:20.385457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:20.386335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:20.392787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:20.392787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:20.405827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 617/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:20.412352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.511301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a7bc-7704-46b0-9678-00358f2e0b6a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:20.548868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:20.549567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:20.549852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:20.550183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:20.609393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:20.615917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:20.617357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:20.710546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 624/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:47:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 20:47:20.716341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.744512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:20.814879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334f8a-3a2c-4f64-9aee-2041a70f5786 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:20.848930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:20.849712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:20.850040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:20.850317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:20.860019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:20.861714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:20.880100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:20.881169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:20.882247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:20.882247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:20.882247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:20.882247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:20.882247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 618/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:20.887006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:20.977610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:20.983399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e2df5-b92b-462c-98e8-183ae5337e30 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:21.017109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:21.017761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:21.018075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:21.018345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:21.019056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:21.019356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:21.021316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:21.032155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 625/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:21.038107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:21.115463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:21.136622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97a1d-634f-4f31-af07-46edeff87070 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:21.169505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:21.170322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:21.170601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:21.170876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:21.177995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:21.179425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:21.193425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:21.194473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:21.195387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 619/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:21.200843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:21.299062 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007b0e-e4dd-443f-a5e0-352d1054c4ce None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:21.332300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:21.333476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:21.333759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:21.334070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:21.334863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:21.335173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:21.336604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6e22f-6516-4b84-be90-eb7e6d1022c3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:21.349070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 626/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:21.355280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:21.454271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc829-3a49-47d7-825d-cf7e10dc34ca None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:21.488571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:21.489373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:21.489710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:21.490034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:21.490868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] RBAC: Adding query filter params (role.id=576c3ae6c0174ec0ac84969b5881c954, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=a8b4d719ef17413e8f7c69f84348851a) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:21.491178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:21.492589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babffac-ab83-4fce-85ea-ffb5263b8d16 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:21.498615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 620/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:47:21 2022] GET /identity/v3/role_assignments?user.id=a8b4d719ef17413e8f7c69f84348851a&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=576c3ae6c0174ec0ac84969b5881c954 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:23.805766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea598-b5a2-4f0e-835a-dc2bfc5b8af1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:23.806299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea598-b5a2-4f0e-835a-dc2bfc5b8af1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:23.806422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea598-b5a2-4f0e-835a-dc2bfc5b8af1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:23.807723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 627/1247] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:23.813093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:23.813499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:23.813648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:23.819215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:23.831263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:23.832450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:23.899895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 621/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 20:47:23.922549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea598-b5a2-4f0e-835a-dc2bfc5b8af1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:23.940598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:24.021648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea598-b5a2-4f0e-835a-dc2bfc5b8af1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.053704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.054425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.054713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.054992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.064974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:24.073097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:24.074261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:24.075161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 628/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:24.080542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:24.180249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0a15-f07a-4346-ba6e-c9eae100eb35 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.210085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:24.214956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.215635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.215917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.216195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.216951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:24.217257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:24.218730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:24.226805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 622/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:47:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:24.232750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:24.310288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:24.332317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a396-2eb8-442e-b7f1-c81821c2db5a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.365262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.366087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.366371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.366646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.376946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:24.378420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:24.396572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:24.397629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:24.398837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:24.398837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:24.398837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:24.398837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:24.398837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 629/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:24.403738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:24.630445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608f625-a2db-4142-b056-b97958c42cd8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.664050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.664769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.665051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.665326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.666087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:24.666397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:24.667758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:24.680481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 623/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:24.686281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:24.784850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def98f4d-0bf2-4d68-be9c-81cb63cf0d21 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.811727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:24.819584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.820379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.820658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.820926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.828317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:24.829743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:24.843768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:24.844997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:24.846016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 630/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:24.851712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:24.908095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:24.953373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dead5-c9ef-44b3-b474-eb626f49064b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:24.989077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:24.990324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:24.990731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:24.991225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:24.992727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:24.993090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:24.994567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:25.011738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 624/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:25.017547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:25.246598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ebadc-c834-445f-9bf2-8d87dbfd51b7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:25.280090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:25.280734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:25.281010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:25.281281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:25.336164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:25.348281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:25.349760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:25.445091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 631/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:47:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:47:25.450914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:25.548029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e344d-4ce3-423b-bc62-8aa4dd788c44 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:25.560922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:25.581187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:25.582018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:25.582303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:25.582577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:25.592901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:25.594368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:25.612786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:25.613870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:25.614919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:25.614919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:25.614919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:25.614919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:25.614919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 625/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:25.619673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:25.704565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:25.715781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2f5f-8b72-4f67-b729-d254621cb11b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:25.747871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:25.748521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:25.748800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:25.749070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:25.749788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:25.750121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:25.751477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:25.762831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 632/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:25.768433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:25.867490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583b71c-763d-4ffa-92c8-3ecd47108bfc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:25.899975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:25.905766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:25.905766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:25.905766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:25.907848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:25.909264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:25.923090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:25.924135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:25.925247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 626/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:25.930789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:26.025964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacb5c0-1e66-49eb-9e9b-a907358fa1fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:26.058381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:26.059027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:26.059305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:26.059577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:26.060354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:26.060659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:26.062090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88395b-634b-4f6f-808d-4679feb1da68 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:26.074244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 633/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:26.080550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:26.105766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:26.184671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17aeb7-7a13-4e04-a47d-90f6c6726af2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:26.217623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:26.218303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:26.218587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:26.218863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:26.219693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=a8b4d719ef17413e8f7c69f84348851a) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:26.220004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:26.221477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd804d-5902-44c9-b294-d836068ab2a9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:26.227317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 627/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:47:26 2022] GET /identity/v3/role_assignments?user.id=a8b4d719ef17413e8f7c69f84348851a&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:28.433318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e66b9-f2b8-4751-a038-30fab373ef0e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:28.433878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e66b9-f2b8-4751-a038-30fab373ef0e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:28.433878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e66b9-f2b8-4751-a038-30fab373ef0e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:28.435256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 634/1261] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:28.440415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:28.440863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:28.440966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:28.457784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:28.459069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:28.525771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 628/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:28.549376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e66b9-f2b8-4751-a038-30fab373ef0e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:28.560698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:28.652341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e66b9-f2b8-4751-a038-30fab373ef0e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:28.685985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:28.686699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:28.687253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:28.687537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:28.697415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:28.704891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:28.709792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:28.710848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 635/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:28.712883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:28.731992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:28.812555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe3bd5-23f6-4e1b-aac6-4c2460de7d6e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:28.846215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:28.846881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:28.847163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:28.847436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:28.848181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:28.848484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:28.850459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:28.858613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 629/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:28.864799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:28.930055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:28.961869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4515e-4e12-433b-b4de-09b39c417d8e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:28.993848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:28.994659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:28.994939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:28.995213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.005232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.006823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:29.024477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:29.027741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:29.028846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:29.028846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:29.028846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:29.028846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:29.028846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 636/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:29.031918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.114674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:29.134420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97704b-3a78-48bd-a47c-39a9817e05df None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.168858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.169513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.169791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.170090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.170805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:29.171106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.172444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.183613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 630/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:29.189819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.289689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4cb8-82cb-4229-ba24-098f012fd7c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.309425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:29.323480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.324321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.324600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.324871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.332323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.334462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:29.348367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:29.349507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:29.352756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 637/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:29.355536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.454937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402383a-4538-47f0-b344-ee3c3e6e5f17 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.490335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.491005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.491287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.491562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.492409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:29.492718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.494175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.509405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:29.517949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 631/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:29.523815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.622898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac186a-b882-4442-b1b7-2bcaaca9ee68 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.656014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.656792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.657074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.657351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.668196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.669622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:29.686310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:29.687391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:29.688310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:29.688310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:29.688310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:29.688310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:29.688310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 638/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:29.693286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.792658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dd505-260d-451b-8ada-3d4f9a5887ad None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.826581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.827246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.827526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.827799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.828530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:29.828866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.830276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:29.842359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 632/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:29.848018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:29.879422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:29.946209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291c5f-e8f1-48f4-8410-f35764ee5690 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:29.979199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:29.979984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:29.980267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:29.980543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:29.987230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:29.988687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:30.002472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:30.003713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:30.005382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 639/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:30.010164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:30.069098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:30.109251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d1812-df91-4fa1-b92c-c988841c3170 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:30.141805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:30.142425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:30.142710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:30.142984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:30.143763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:30.144068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:30.145475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253283e-4944-4e93-96a5-a7ea53cb113a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:30.158400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 633/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:30.164664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:30.252341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:30.261160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcf620-d1b6-44c5-b36f-bdfea914fcb3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:30.294046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:30.294950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:30.295234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:30.295509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] PATH_INFO: `/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/a8b4d719ef17413e8f7c69f84348851a/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:30.297727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbd36d7f7b49dead3e86dd064707f3, user_id=a8b4d719ef17413e8f7c69f84348851a, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:30.299194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ae777-96c1-449a-aa3f-9b0e993b6de9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:30.417373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 640/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Tue May 31 20:47:30 2022] PUT /identity/v3/projects/bbdbd36d7f7b49dead3e86dd064707f3/users/a8b4d719ef17413e8f7c69f84348851a/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:47:32.638491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79728-171a-408e-992d-0b27fea3d9ea None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:32.639135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79728-171a-408e-992d-0b27fea3d9ea None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:32.639135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79728-171a-408e-992d-0b27fea3d9ea None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:32.640398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 634/1274] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:32.646109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:32.646484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:32.646677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:32.663950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:32.665154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:32.731190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 641/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:32.755091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c79728-171a-408e-992d-0b27fea3d9ea None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:32.856203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c79728-171a-408e-992d-0b27fea3d9ea None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:32.873250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:32.889735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:32.890489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:32.890765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:32.891037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:32.901264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 20:47:32.908871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:32.910049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:32.911383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 635/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Tue May 31 20:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:32.916439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:32.997740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:33.016231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779801f9-485f-4089-8a91-ccb2b362eb7c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.051618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.052282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.052565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.052842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.053590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:33.053917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.055294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:33.063116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 642/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Tue May 31 20:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:33.069359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:33.165883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c8de-59a3-4961-ab0c-6ec66f49ad6b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.199386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.200199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.200477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.200747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.210981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.215375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:33.229059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:33.230206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:33.231148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:33.231148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:33.231148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:33.231148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:33.231148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 636/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:33.236489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:33.335791 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292ae64-8fd6-45b6-88bb-450277d6574f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.368446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.369102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.369387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.369664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.370414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:33.370727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.372091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:33.384136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 643/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:33.389855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:33.420575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:33.487424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99336dae-bd2f-41fb-a97c-47267ababae5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.520130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.520948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.521227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.521501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.528746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.530199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 20:47:33.544248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:33.545334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:33.546365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 637/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 20:47:33.551412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:33.555706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:33.655575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac950e-4398-4686-afc0-8c9966ab95a4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.689344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.690095 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.690379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.690654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.691496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:33.691801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.693258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:33.710943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 644/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Tue May 31 20:47:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:33.716154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:33.806207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:33.815568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e7964-cd7b-459a-b92e-72daf6ee261f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:33.848298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:33.849521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:33.849806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:33.850144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:33.915409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:33.916856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.003643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:34.013266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 638/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Tue May 31 20:47:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 20:47:34.019325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:34.080869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:34.119242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb75e43-4255-486e-b984-2923e4c53351 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:34.152033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:34.152819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:34.153106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:34.153378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:34.163470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:34.164908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 20:47:34.181518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:34.182551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:34.183520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 20:47:34.183520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 20:47:34.183520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 20:47:34.183520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:34.183520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 645/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:34.188849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:34.290859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f6216-6808-4080-a01a-a29ff4e665f0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:34.326667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:34.327332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:34.327621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:34.327890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:34.328608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:34.328911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:34.330303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.342266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 639/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Tue May 31 20:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:34.348013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:34.445589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db23e4-bb7d-4d60-8702-31ef529dd668 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:34.459914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:34.479937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:34.480727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:34.481010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:34.481283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:34.488190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:34.489653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 20:47:34.503308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:34.504348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application May 31 20:47:34.506185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 646/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Tue May 31 20:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:34.511070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:34.560093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:34.609954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d576c-9cf4-4897-9421-6601f210ea6f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:34.643246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:34.643891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:34.644168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:34.644442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:34.645216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:34.645519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:34.647511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f471a-b4ea-4435-910c-3c81efab281f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.659154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 640/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Tue May 31 20:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:47:34.665271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:34.764763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bdc00-45af-4a04-8504-29d74f6d5c08 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:34.799231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:34.799886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:34.800165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:34.800467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:34.801300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] RBAC: Adding query filter params (role.id=95bfdf5b1a1643009d426b6b0d876130, scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3, user.id=a8b4d719ef17413e8f7c69f84348851a) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:34.801609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:34.803585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3179-2b5f-4e70-87d3-a6d1b449dbc5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:34.809325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 647/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Tue May 31 20:47:34 2022] GET /identity/v3/role_assignments?user.id=a8b4d719ef17413e8f7c69f84348851a&scope.project.id=bbdbd36d7f7b49dead3e86dd064707f3&role.id=95bfdf5b1a1643009d426b6b0d876130 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:37.088208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf102-c85c-4b15-b855-343e0bf2dd9c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:37.088766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf102-c85c-4b15-b855-343e0bf2dd9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:37.088766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cf102-c85c-4b15-b855-343e0bf2dd9c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:37.090060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 641/1288] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:37.095650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:37.096074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:37.096280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:37.113487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:37.114796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:37.143909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:37.187398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 648/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:37.210713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cf102-c85c-4b15-b855-343e0bf2dd9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:37.311560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cf102-c85c-4b15-b855-343e0bf2dd9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:37.322982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:37.345647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:37.346416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:37.346823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:37.346954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:37.347601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:37.348952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:37.360765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:37.368499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:37.369648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 642/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:47:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:37.370760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:37.466333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee52b-3df8-4b72-9f77-58881a4b8f62 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:37.499507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:37.500168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:37.500449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:37.500724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:37.501429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:37.501735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:37.503133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3e2d-0b0c-43fd-a6db-3dc8a99dd834 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:37.508994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 649/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 31 20:47:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:37.514967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:37.613787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a561297-6dc1-4564-abda-8b53567d561f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:37.647448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:37.648150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:37.648425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:37.648741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:37.649446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:37.649750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:37.651128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd359-dfcd-4058-91bf-189d2a69719f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:37.655459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 643/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 31 20:47:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 20:47:39.886694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae28bd-7111-4006-9e8a-b1ebab6ade77 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:39.887210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae28bd-7111-4006-9e8a-b1ebab6ade77 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:39.887316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae28bd-7111-4006-9e8a-b1ebab6ade77 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:39.888607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 650/1293] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:39.893934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3565d-61c7-4152-ab26-ea51ca2fac3b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:39.894347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3565d-61c7-4152-ab26-ea51ca2fac3b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:39.894506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3565d-61c7-4152-ab26-ea51ca2fac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:39.910813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fec3565d-61c7-4152-ab26-ea51ca2fac3b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:39.912525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fec3565d-61c7-4152-ab26-ea51ca2fac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:39.941571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:39.977308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 644/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:40.000144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae28bd-7111-4006-9e8a-b1ebab6ade77 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:40.030488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:40.097861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae28bd-7111-4006-9e8a-b1ebab6ade77 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:40.130940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:40.131601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:40.131881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:40.132157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:40.132882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:40.134319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdb6db-48c1-4fef-85bd-769b73e17c1c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:40.221308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 651/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Tue May 31 20:47:39 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:47:42.491818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b266ab8-a8e2-42a7-bf59-629071af6bba None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:42.492353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b266ab8-a8e2-42a7-bf59-629071af6bba None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:42.492353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b266ab8-a8e2-42a7-bf59-629071af6bba None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:42.493845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 645/1296] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:42.498922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:42.499343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:42.499506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:42.516019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:42.517201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:42.590087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 652/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:42.612929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b266ab8-a8e2-42a7-bf59-629071af6bba None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:42.716303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b266ab8-a8e2-42a7-bf59-629071af6bba None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:42.750831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:42.751558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:42.751840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:42.752119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:42.752771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:42.754169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:42.766557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:42.767706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:42.774303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 646/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:47:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:42.775122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:42.793627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:42.871701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e7c5-7a26-4626-9b46-6e7cf6dbc0b3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:42.905778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:42.906492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:42.906750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:42.907032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:42.907736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:42.908043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:42.909410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:42.914456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 653/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 31 20:47:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:42.920440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:42.952945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:43.019270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b05ffc-e388-4cd6-9c2d-7591447ce7f4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:43.054179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:43.054830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:43.055113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:43.055390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:43.056180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] RBAC: Adding query filter params (interface=public, service_id=44878a5c45b94916822197f465ef14a8, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:43.056503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:43.057850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a0edc-53be-4b2e-99cd-6dc1721cc0e1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:43.063655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 647/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Tue May 31 20:47:42 2022] GET /identity/v3/endpoints?service_id=44878a5c45b94916822197f465ef14a8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:43.069250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:43.150916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:43.168249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b53e8-5857-4225-b255-289455ed8591 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:43.201033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:43.201689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:43.202006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:43.202333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:43.203046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:43.204406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f818b-690b-4464-b4dc-f0cc65373b70 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:43.211034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 654/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Tue May 31 20:47:43 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:47:45.449439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa21-aba7-4e26-b60e-1aff6d6df32b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:45.450062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa21-aba7-4e26-b60e-1aff6d6df32b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:45.450062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3caa21-aba7-4e26-b60e-1aff6d6df32b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:45.451377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 648/1302] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:47:45.456676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:45.457053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:45.457237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:45.473806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:47:45.475025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:47:45.541127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 655/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 20:47:45.564503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3caa21-aba7-4e26-b60e-1aff6d6df32b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:45.656667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:45.663834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3caa21-aba7-4e26-b60e-1aff6d6df32b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:45.696275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:45.697109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:45.697389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:45.697658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:45.698339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:45.699766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 20:47:45.711626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 20:47:45.712649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application May 31 20:47:45.713542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 649/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Tue May 31 20:47:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 20:47:45.720309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:45.793818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:45.816181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea9e4-7b59-45e3-9a4d-21ae66250d06 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:45.848707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:45.850021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:45.850281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:45.850552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:45.851263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:47:45.851563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:45.852970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a378f-ee5d-4efe-8c55-8ea79fb8e454 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:45.858006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 656/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Tue May 31 20:47:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:47:45.864213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:47:45.962181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106223-ee20-4972-a0b9-3eb88dfc94c7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:47:45.995362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:47:45.996006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:47:45.996285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:47:45.996562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:47:45.997290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:47:45.998733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e367d-5c69-4bfa-b8e6-d038fccb3de9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:47:46.107330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 650/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Tue May 31 20:47:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:47:55.855017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=30 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:47:56.102762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:45.044016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dd82-677e-423e-98e3-7e5729dad02a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:45.044448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dd82-677e-423e-98e3-7e5729dad02a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:45.044895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dd82-677e-423e-98e3-7e5729dad02a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:45.046172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 657/1307] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:45.052138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529170-078f-47eb-8225-a18ddbe288ce None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:45.053232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529170-078f-47eb-8225-a18ddbe288ce None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:45.053730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529170-078f-47eb-8225-a18ddbe288ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:45.165598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-79529170-078f-47eb-8225-a18ddbe288ce None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:45.171594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-79529170-078f-47eb-8225-a18ddbe288ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:45.310137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 651/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:45.357568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:45.357970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:45.358347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:45.359986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 658/1309] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 31 20:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:45.368286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80967-9127-4680-b8f8-d42d3def39bc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:45.368624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80967-9127-4680-b8f8-d42d3def39bc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:45.368814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80967-9127-4680-b8f8-d42d3def39bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:45.472988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bff80967-9127-4680-b8f8-d42d3def39bc None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:45.474247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bff80967-9127-4680-b8f8-d42d3def39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:45.500481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:45.561052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 652/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 31 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:45.571475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:54:45.573364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:45.705025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873a51-c76d-4ffc-a609-5bafe0137b90 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:54:45.790879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:54:45.791636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:45.792013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:45.792351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:45.794632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:45.861135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:45.927626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:54:45.929523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ecf61-58a5-4692-915b-1673eeb8fb30 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:54:45.950470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 659/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:54:48.506336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:48.506941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:48.506941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:48.508262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 653/1312] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:48.514311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aee25-ef7b-483e-a2b2-1f58e49c45f5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:48.514841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aee25-ef7b-483e-a2b2-1f58e49c45f5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:48.515036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aee25-ef7b-483e-a2b2-1f58e49c45f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:48.604687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-302aee25-ef7b-483e-a2b2-1f58e49c45f5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:48.606252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-302aee25-ef7b-483e-a2b2-1f58e49c45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:48.729077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 660/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:48.768538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:54:48.770234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:48.902164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a2494-feb4-4b70-9175-f4d03d62e0ab None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:54:48.981789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:48.984519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:54:48.985059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:48.985346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:48.985875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:48.987648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:49.108657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:54:49.110284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab07c-4ae6-43a1-b32e-330b1a5a6ff0 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:54:49.130920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 654/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:54:51.965524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:51.966088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:51.966088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:51.967693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 661/1315] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:51.973094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf697c-5d12-49ed-8efc-75ffc75d0692 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:51.973604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf697c-5d12-49ed-8efc-75ffc75d0692 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:51.973697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf697c-5d12-49ed-8efc-75ffc75d0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:52.039291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2edf697c-5d12-49ed-8efc-75ffc75d0692 None None] MFA Rules not processed for user `574f3416e5e549e58ce2fb7218b67c18`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:52.040492 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2edf697c-5d12-49ed-8efc-75ffc75d0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:52.091846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:52.137313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 655/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:52.176527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:54:52.178089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:52.188151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:52.282638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17862cf-b21b-4b8c-9918-a9a586539455 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:54:52.361827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:54:52.362525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:52.363509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:52.363675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:52.365434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:52.430252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:52.479100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:54:52.480798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850382fe-cc01-48c7-90dc-66fe33867856 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:54:52.498927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 662/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:54:55.570605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9e10-9966-468a-a36e-5c1f558226af None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:55.571111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9e10-9966-468a-a36e-5c1f558226af None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:55.571111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9e10-9966-468a-a36e-5c1f558226af None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:55.572455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 656/1318] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:55.577809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49f19a-09f7-4cd6-90f5-1ace7a01c2e3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:55.578269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49f19a-09f7-4cd6-90f5-1ace7a01c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:55.578425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49f19a-09f7-4cd6-90f5-1ace7a01c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:55.643776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6d49f19a-09f7-4cd6-90f5-1ace7a01c2e3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:55.645036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6d49f19a-09f7-4cd6-90f5-1ace7a01c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:55.742156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 663/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:55.797310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:55.797596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:55.797871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:55.799273 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 657/1320] 10.222.0.55 () {54 vars in 964 bytes} [Tue May 31 20:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:54:55.806022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfdc1-7197-42cf-ab4d-c797f3202ee7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:55.806319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfdc1-7197-42cf-ab4d-c797f3202ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:55.806601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcfdc1-7197-42cf-ab4d-c797f3202ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:55.827802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:55.882074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-febcfdc1-7197-42cf-ab4d-c797f3202ee7 None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:54:55.883329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-febcfdc1-7197-42cf-ab4d-c797f3202ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:55.959229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 664/1321] 10.222.0.55 () {58 vars in 1061 bytes} [Tue May 31 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:54:55.968611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:54:55.970183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:56.076927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea4af0-bd14-4d54-82df-b66e63326456 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:54:56.151482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:54:56.152050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:54:56.152331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:54:56.152604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:54:56.154332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:54:56.162494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:54:56.268163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:54:56.269604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e8e2-f556-4795-b7b0-c51497d0b33d service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:54:56.292108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 658/1322] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:00.085293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:00.085965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:00.085965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:00.087164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 665/1323] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:00.092713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f067b9-d4ea-4b92-a50a-3226a72dbf8c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:00.093178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f067b9-d4ea-4b92-a50a-3226a72dbf8c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:00.093407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f067b9-d4ea-4b92-a50a-3226a72dbf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:00.160400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d3f067b9-d4ea-4b92-a50a-3226a72dbf8c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:00.161660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d3f067b9-d4ea-4b92-a50a-3226a72dbf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:00.219395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:00.258649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 659/1324] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:00.299540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:00.301350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:00.407727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413b16c-fc0c-4bc4-8335-1bbd5b3d716e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:00.420680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:00.484562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:00.485231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:00.485517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:00.485796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:00.487515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:00.602703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:00.604179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0ff9e-8c09-406b-8123-d4a3be2b55b7 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:00.623264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 666/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:02.955554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:02.956186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:02.956797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:02.958400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 660/1326] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:02.964460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca394b-c24c-4f14-90e3-1010d92a12c4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:02.965018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca394b-c24c-4f14-90e3-1010d92a12c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:02.965018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca394b-c24c-4f14-90e3-1010d92a12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:03.014931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:03.033641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ccca394b-c24c-4f14-90e3-1010d92a12c4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:03.034938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ccca394b-c24c-4f14-90e3-1010d92a12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:03.133513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 667/1327] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:03.169365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:03.170951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:03.280116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9b31-6447-4765-b751-ced86d0773ab None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:03.365179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:03.366026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:03.366307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:03.366580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:03.368237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:03.385593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:03.483870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:03.485321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a308bc-2d49-48cf-822c-181a870f23bd service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:03.504394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 661/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:05.822443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:05.822971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:05.822971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:05.824364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 668/1329] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:05.829725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941be9e-743e-47fe-8a33-42fc6aa5c4f3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:05.830174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941be9e-743e-47fe-8a33-42fc6aa5c4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:05.830315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941be9e-743e-47fe-8a33-42fc6aa5c4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:05.900250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0941be9e-743e-47fe-8a33-42fc6aa5c4f3 None None] MFA Rules not processed for user `574f3416e5e549e58ce2fb7218b67c18`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:05.901469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0941be9e-743e-47fe-8a33-42fc6aa5c4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:05.968412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:06.000811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 662/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:06.039108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:06.040685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:06.148196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64ca4-44a8-4b9d-9cff-2c0c27277cd5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:06.167978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:06.222755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:06.223415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:06.223701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:06.223981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:06.225631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:06.337668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:06.339193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63582060-d529-4f19-9216-f747f28f144b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:06.357799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 669/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:09.043369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:09.043929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:09.043929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:09.045296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 663/1332] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:09.051020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3092d3-7f01-4410-9b8a-d4b97785b49c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:09.051458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3092d3-7f01-4410-9b8a-d4b97785b49c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:09.051561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3092d3-7f01-4410-9b8a-d4b97785b49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:09.122758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:09.125177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ca3092d3-7f01-4410-9b8a-d4b97785b49c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:09.126442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ca3092d3-7f01-4410-9b8a-d4b97785b49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:09.229794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 670/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:55:09.267233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:09.268770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:09.405095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77a4f-1cc1-4c88-b59a-ca6719615954 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:09.483969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:09.484627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:09.484938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:09.485217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:09.487106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:09.516047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:09.602979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:09.604447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b94160-4463-479d-b5e8-70cda1c1d7f9 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:09.625171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 664/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:11.958395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:11.958923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:11.959043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:11.960343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 671/1335] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:55:11.965756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f1b-97ef-4102-9099-a7a7f125aab5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:11.966173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f1b-97ef-4102-9099-a7a7f125aab5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:11.966358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b6f1b-97ef-4102-9099-a7a7f125aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:12.030410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8a0b6f1b-97ef-4102-9099-a7a7f125aab5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:12.031613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8a0b6f1b-97ef-4102-9099-a7a7f125aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:12.114408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:12.131095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 665/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:12.170320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:12.171863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:12.272957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84d399-133e-4fe2-b019-9d01cfd04bd1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:12.300876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:12.344857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:12.345502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:12.345779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:12.346079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:12.347811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:12.453087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:12.454557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ece906-a59b-4070-b336-99f071eec96c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:12.472879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 672/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:15.446442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:15.446992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:15.446992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:15.448357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 666/1338] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:15.453699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b67-d466-4c7c-a388-47aa65542183 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:15.454173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b67-d466-4c7c-a388-47aa65542183 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:15.454293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55b67-d466-4c7c-a388-47aa65542183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:15.521648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bde55b67-d466-4c7c-a388-47aa65542183 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:15.522892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bde55b67-d466-4c7c-a388-47aa65542183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:15.530903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:15.624989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 673/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:15.661601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:15.663752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:15.771833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019056b2-d93a-4dbe-bf59-9193ad9b3f64 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:15.775417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:15.776064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:15.776344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:15.776618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:15.866186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:15.867564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c808d2-d11e-4c8e-bb08-81c63246a471 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:15.886344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 667/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:20.608167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b23b0-f76a-4931-9fac-5c9613475fe6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:20.608719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b23b0-f76a-4931-9fac-5c9613475fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:20.608719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b23b0-f76a-4931-9fac-5c9613475fe6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:20.610152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 674/1341] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:20.615606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69b8c-9898-4895-b48f-76f040fcc97f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:20.616057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69b8c-9898-4895-b48f-76f040fcc97f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:20.616165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69b8c-9898-4895-b48f-76f040fcc97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:20.625509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:20.685576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-25b69b8c-9898-4895-b48f-76f040fcc97f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:20.686846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-25b69b8c-9898-4895-b48f-76f040fcc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:20.766687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 668/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:20.804867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b23b0-f76a-4931-9fac-5c9613475fe6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:20.816615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b23b0-f76a-4931-9fac-5c9613475fe6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:20.820038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:20.820671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:20.820954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:20.821221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:20.830886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:20.832337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd281f-a79a-498b-9aa3-6fcb82a9746c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:20.841734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 675/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:24.008404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172ebc-e823-407c-ad59-dd997b2ca56b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:24.008996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172ebc-e823-407c-ad59-dd997b2ca56b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:24.008996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172ebc-e823-407c-ad59-dd997b2ca56b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:24.010639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 669/1344] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:24.016037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25971-a6aa-4fa2-b146-41ab720d4706 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:24.016810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25971-a6aa-4fa2-b146-41ab720d4706 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:24.016810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25971-a6aa-4fa2-b146-41ab720d4706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:24.044954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8be25971-a6aa-4fa2-b146-41ab720d4706 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:24.046283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8be25971-a6aa-4fa2-b146-41ab720d4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:24.054147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 676/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:24.091818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172ebc-e823-407c-ad59-dd997b2ca56b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:24.105820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172ebc-e823-407c-ad59-dd997b2ca56b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:24.109320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:24.109980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:24.110260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:24.110533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:24.120050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:24.121473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e634f7-cfd0-4968-9ca1-03330bc8b98c service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:24.131576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 670/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:28.744698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:28.745335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:28.745335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:28.746593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 677/1347] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:55:28.752131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b859-1aa5-4859-aa47-4f4859bf25e0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:28.752674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b859-1aa5-4859-aa47-4f4859bf25e0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:28.752674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b859-1aa5-4859-aa47-4f4859bf25e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:28.771396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8941b859-1aa5-4859-aa47-4f4859bf25e0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:28.772522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8941b859-1aa5-4859-aa47-4f4859bf25e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:28.780460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 671/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:28.818607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:28.820360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:28.834843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259a711-1b70-4109-81ae-b6f5e8404cc5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:28.838463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:28.839136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:28.839427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:28.839710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:28.849507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:28.850976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac39e9-2fa3-445f-9085-1354380ff3d4 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:28.861185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 678/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:34.431077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6343e6-e896-4d00-89f7-8a35ae15c1db None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:34.431626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6343e6-e896-4d00-89f7-8a35ae15c1db None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:34.431626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6343e6-e896-4d00-89f7-8a35ae15c1db None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:34.433264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 672/1350] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 20:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:34.438406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133455-aadc-405a-b598-dbdfed380240 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:34.439332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133455-aadc-405a-b598-dbdfed380240 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:34.439822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133455-aadc-405a-b598-dbdfed380240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:34.526129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d5133455-aadc-405a-b598-dbdfed380240 None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:34.527710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5133455-aadc-405a-b598-dbdfed380240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:34.582018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:34.615722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 679/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:38.765346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=56 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:55:39.231929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07d1e-16f6-4cc3-a4c4-883673047bc0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:39.232436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07d1e-16f6-4cc3-a4c4-883673047bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:39.232919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07d1e-16f6-4cc3-a4c4-883673047bc0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:39.234525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 673/1352] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 20:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:39.239616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce88d-b56b-4a22-98e5-fb1e45de0930 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:39.240564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce88d-b56b-4a22-98e5-fb1e45de0930 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:39.241075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce88d-b56b-4a22-98e5-fb1e45de0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:39.261229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-624ce88d-b56b-4a22-98e5-fb1e45de0930 None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:39.262483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-624ce88d-b56b-4a22-98e5-fb1e45de0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:39.271973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 680/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:40.756741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021702ae-e627-45a7-a3a0-b9821e1f477e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:40.757310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021702ae-e627-45a7-a3a0-b9821e1f477e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:40.757310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021702ae-e627-45a7-a3a0-b9821e1f477e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:40.758722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 674/1354] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 20:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:40.763820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7689ab-1fca-40ab-8200-197436de1671 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:40.764249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7689ab-1fca-40ab-8200-197436de1671 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:40.764594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7689ab-1fca-40ab-8200-197436de1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:40.783999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1d7689ab-1fca-40ab-8200-197436de1671 None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:40.785373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1d7689ab-1fca-40ab-8200-197436de1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:40.794546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 681/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:44.750672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cd63-b12c-4737-ae71-9e6f56ebe170 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:44.751964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cd63-b12c-4737-ae71-9e6f56ebe170 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:44.752310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cd63-b12c-4737-ae71-9e6f56ebe170 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:44.758506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 675/1356] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:44.760856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c194043-a204-45b3-b42e-87801b259d61 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:44.761328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c194043-a204-45b3-b42e-87801b259d61 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:44.761473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c194043-a204-45b3-b42e-87801b259d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:44.780343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7c194043-a204-45b3-b42e-87801b259d61 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:44.781643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7c194043-a204-45b3-b42e-87801b259d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:44.793235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 682/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:44.858264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55d79-2eb7-4478-9c8d-dffe9e950c8b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:44.858552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55d79-2eb7-4478-9c8d-dffe9e950c8b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:44.858831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a55d79-2eb7-4478-9c8d-dffe9e950c8b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:44.860913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 676/1358] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 31 20:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:44.869776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2787728-fcc8-48ce-b2c8-d6e716b5b1c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:44.869979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2787728-fcc8-48ce-b2c8-d6e716b5b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:44.870177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2787728-fcc8-48ce-b2c8-d6e716b5b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:44.933529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f2787728-fcc8-48ce-b2c8-d6e716b5b1c3 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:44.935101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f2787728-fcc8-48ce-b2c8-d6e716b5b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:45.023917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 683/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 31 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:45.032935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a55d79-2eb7-4478-9c8d-dffe9e950c8b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:45.048670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a55d79-2eb7-4478-9c8d-dffe9e950c8b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:45.054687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:45.055428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:45.055785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:45.056134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:45.065591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:45.067311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e600a-cce9-483b-95c0-5832c1033fa7 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:45.078310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 677/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:47.616573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d1a9-0afc-432a-beb7-56072be4eb4a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:47.617125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d1a9-0afc-432a-beb7-56072be4eb4a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:47.617125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d1a9-0afc-432a-beb7-56072be4eb4a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:47.620263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 684/1361] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:47.623906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09b10-2bb0-4c63-88d1-0860b6aef1f0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:47.624346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09b10-2bb0-4c63-88d1-0860b6aef1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:47.624462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09b10-2bb0-4c63-88d1-0860b6aef1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:47.647560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-00f09b10-2bb0-4c63-88d1-0860b6aef1f0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:47.648772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-00f09b10-2bb0-4c63-88d1-0860b6aef1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:47.656902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 678/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:47.701218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d1a9-0afc-432a-beb7-56072be4eb4a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:47.715494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d1a9-0afc-432a-beb7-56072be4eb4a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:47.721506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:47.722175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:47.722462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:47.722736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:47.732658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:47.734277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5f174-0649-4f09-846f-f94f4ed39c23 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:47.745185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 685/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:50.470654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe358-a43a-4dcb-b0b4-305df986ece4 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:50.471149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe358-a43a-4dcb-b0b4-305df986ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:50.471149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbe358-a43a-4dcb-b0b4-305df986ece4 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:50.472513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 679/1364] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:50.478366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edacf8-45c7-4cd5-8d68-9f57e61a8b0b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:50.478788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edacf8-45c7-4cd5-8d68-9f57e61a8b0b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:50.479065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edacf8-45c7-4cd5-8d68-9f57e61a8b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:50.497990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-20edacf8-45c7-4cd5-8d68-9f57e61a8b0b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:50.499188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20edacf8-45c7-4cd5-8d68-9f57e61a8b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:50.507622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 686/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:50.554925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c91d-73ff-47b4-a7bf-60c619428390 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:50.555289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c91d-73ff-47b4-a7bf-60c619428390 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:50.555575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c91d-73ff-47b4-a7bf-60c619428390 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:50.556936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 680/1366] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 31 20:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:50.562546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daba8f-bc69-4fe2-bbc8-4a23bec31677 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:50.562843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daba8f-bc69-4fe2-bbc8-4a23bec31677 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:50.563784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daba8f-bc69-4fe2-bbc8-4a23bec31677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:50.583164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e3daba8f-bc69-4fe2-bbc8-4a23bec31677 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:50.584372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e3daba8f-bc69-4fe2-bbc8-4a23bec31677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:50.593636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 687/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 31 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:50.601406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c91d-73ff-47b4-a7bf-60c619428390 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:50.616507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c91d-73ff-47b4-a7bf-60c619428390 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:50.621954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:50.622652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:50.622934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:50.623212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:50.632002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:50.633583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ebefd-062e-422f-a002-d63b0d43f365 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:50.642957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 681/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:53.199157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85c08-3404-4988-a064-61cc5ddfbffa None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.199749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85c08-3404-4988-a064-61cc5ddfbffa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.199749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85c08-3404-4988-a064-61cc5ddfbffa None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.201430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 688/1369] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:53.207753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.208322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.208421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.211345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032443b5-761b-48be-abba-e9dc5356d7ee None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.211649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032443b5-761b-48be-abba-e9dc5356d7ee None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.212077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032443b5-761b-48be-abba-e9dc5356d7ee None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.213653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 689/1370] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:53.219996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41438-b7bf-472c-a3c2-3a4e43263273 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.220428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41438-b7bf-472c-a3c2-3a4e43263273 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.220841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41438-b7bf-472c-a3c2-3a4e43263273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.228913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:53.230197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:53.239124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 682/1371] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:53.240889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d7a41438-b7bf-472c-a3c2-3a4e43263273 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:53.242219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d7a41438-b7bf-472c-a3c2-3a4e43263273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:53.250469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 690/1372] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:55:53.284552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:53.298278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141e723-9c44-47fb-8ca5-0d4c28c106f1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:53.304208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:53.304882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.305168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.305449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.315062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:53.316872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe90a45-2821-4166-96e9-7958cf9bd260 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:53.329036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 683/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:53.599350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3d4b-f967-45ac-8eb4-1d091028d47a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.600007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3d4b-f967-45ac-8eb4-1d091028d47a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.600434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f3d4b-f967-45ac-8eb4-1d091028d47a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.602637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 691/1374] 10.222.0.55 () {54 vars in 963 bytes} [Tue May 31 20:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:53.609181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dec0-37eb-459c-a0a5-053dbad33378 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.610248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dec0-37eb-459c-a0a5-053dbad33378 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.610729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dec0-37eb-459c-a0a5-053dbad33378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.687030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b3a3dec0-37eb-459c-a0a5-053dbad33378 None None] MFA Rules not processed for user `0773ba9f520f432c88ae86143c91b9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:53.689089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b3a3dec0-37eb-459c-a0a5-053dbad33378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:53.780208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f3d4b-f967-45ac-8eb4-1d091028d47a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:53.782589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 684/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Tue May 31 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:53.792905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f3d4b-f967-45ac-8eb4-1d091028d47a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:53.797855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:53.798944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:53.799434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:53.799871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:53.811422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:53.813922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee873f-b56b-4fcf-889d-1fa7ba71737a service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:53.825816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 692/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:55.814532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ef24-7ac6-4c36-91c7-3ee710a38908 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:55.815181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ef24-7ac6-4c36-91c7-3ee710a38908 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:55.815181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772ef24-7ac6-4c36-91c7-3ee710a38908 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:55.816525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 685/1377] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:55:55.823121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5c0e-cfce-4670-9808-55b5e4e35cb4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:55.823715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5c0e-cfce-4670-9808-55b5e4e35cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:55.823715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5c0e-cfce-4670-9808-55b5e4e35cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:55.844090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-018e5c0e-cfce-4670-9808-55b5e4e35cb4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:55.845376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-018e5c0e-cfce-4670-9808-55b5e4e35cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:55.855074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 693/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:55.902371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772ef24-7ac6-4c36-91c7-3ee710a38908 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:55.919408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772ef24-7ac6-4c36-91c7-3ee710a38908 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:55.926036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:55.926763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:55.927120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:55.927427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:55.937423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:55.939901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a8614-65c1-4d1e-bc8f-8340e3aaf4bf service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:55.951532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 686/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:55:58.441312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8214-c0b5-4b49-9907-69a922c7b7b9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:58.441881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8214-c0b5-4b49-9907-69a922c7b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:58.441881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd8214-c0b5-4b49-9907-69a922c7b7b9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:58.443295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 694/1380] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:55:58.449100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c279-9b32-490c-aed3-d9b6dde369a7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:58.449928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c279-9b32-490c-aed3-d9b6dde369a7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:58.450222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c279-9b32-490c-aed3-d9b6dde369a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:58.469556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fc97c279-9b32-490c-aed3-d9b6dde369a7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:55:58.470801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fc97c279-9b32-490c-aed3-d9b6dde369a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:55:58.478983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 687/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:55:58.523832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd8214-c0b5-4b49-9907-69a922c7b7b9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:55:58.541557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd8214-c0b5-4b49-9907-69a922c7b7b9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:55:58.547364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:55:58.548011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:55:58.548301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:55:58.548585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:55:58.557478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:55:58.561171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f613f-b574-4419-aba6-5e41f7471f6c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:55:58.569789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 695/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:01.001750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13dc2-48ca-4d04-bd44-d6b9caaa37bd None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:01.002395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13dc2-48ca-4d04-bd44-d6b9caaa37bd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:01.002395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13dc2-48ca-4d04-bd44-d6b9caaa37bd None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:01.003723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 688/1383] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:01.009423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba20f-87b4-4cec-94ff-1c568a30beed None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:01.009958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba20f-87b4-4cec-94ff-1c568a30beed None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:01.010067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ba20f-87b4-4cec-94ff-1c568a30beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:01.017677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:01.030055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f67ba20f-87b4-4cec-94ff-1c568a30beed None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:01.031832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f67ba20f-87b4-4cec-94ff-1c568a30beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:01.040086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 696/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:01.083094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc13dc2-48ca-4d04-bd44-d6b9caaa37bd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:01.099096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc13dc2-48ca-4d04-bd44-d6b9caaa37bd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:01.105221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:01.106044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:01.106434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:01.106819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:01.116360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:01.118140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf96dfc-a11c-461b-9de2-ce8cdfe3865a service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:01.128772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 689/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:03.458441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503066-228c-4ac3-8cf3-50e7190086ca None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:03.458982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503066-228c-4ac3-8cf3-50e7190086ca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:03.459136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503066-228c-4ac3-8cf3-50e7190086ca None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:03.460406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 697/1386] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:03.467975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab5ad-e6fc-47da-b6df-9703de9c8bd6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:03.468517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab5ad-e6fc-47da-b6df-9703de9c8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:03.469231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab5ad-e6fc-47da-b6df-9703de9c8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:03.504725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ca7ab5ad-e6fc-47da-b6df-9703de9c8bd6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:03.506276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ca7ab5ad-e6fc-47da-b6df-9703de9c8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:03.516797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 690/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:03.561751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503066-228c-4ac3-8cf3-50e7190086ca None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:03.578793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503066-228c-4ac3-8cf3-50e7190086ca None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:03.586429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79702694-3567-4107-be2a-df94709292d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:03.587370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702694-3567-4107-be2a-df94709292d1 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:03.587766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702694-3567-4107-be2a-df94709292d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:03.588165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79702694-3567-4107-be2a-df94709292d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:03.601661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79702694-3567-4107-be2a-df94709292d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:03.604350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79702694-3567-4107-be2a-df94709292d1 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:03.619128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 698/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:06.199154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71485b-a5e6-4891-b510-bf8020778d9c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:06.199725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71485b-a5e6-4891-b510-bf8020778d9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:06.200141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71485b-a5e6-4891-b510-bf8020778d9c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:06.202545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 691/1389] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:06.211864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140838d-29e3-40c6-8a33-a65e446a8300 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:06.212295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140838d-29e3-40c6-8a33-a65e446a8300 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:06.212614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140838d-29e3-40c6-8a33-a65e446a8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:06.238741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4140838d-29e3-40c6-8a33-a65e446a8300 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:06.240993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4140838d-29e3-40c6-8a33-a65e446a8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:06.254812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 699/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:06.303613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71485b-a5e6-4891-b510-bf8020778d9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:06.320758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71485b-a5e6-4891-b510-bf8020778d9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:06.326796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:06.327526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:06.328411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:06.328706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:06.338083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:06.339803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e976463-28aa-4327-b2cd-59968e09dca0 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:06.351897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 692/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:56:08.865566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0df2c-ac19-449a-915c-08a9315106a7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:08.866210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0df2c-ac19-449a-915c-08a9315106a7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:08.866210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0df2c-ac19-449a-915c-08a9315106a7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:08.867686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 700/1392] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:08.872977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc5ff-f269-4680-9563-eacd6ea5e0f0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:08.878200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc5ff-f269-4680-9563-eacd6ea5e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:08.878200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fc5ff-f269-4680-9563-eacd6ea5e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:08.879662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:08.891867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3d3fc5ff-f269-4680-9563-eacd6ea5e0f0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:08.893105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3d3fc5ff-f269-4680-9563-eacd6ea5e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:08.900900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 693/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:08.945111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0df2c-ac19-449a-915c-08a9315106a7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:08.959736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0df2c-ac19-449a-915c-08a9315106a7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:08.965021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:08.965665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:08.965976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:08.966253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:08.975442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:08.977279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90bf3b-fef7-4ba5-af07-eed231d44fbb service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:08.987391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 701/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:10.165864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8303-ffe7-4ee1-bf3e-9e883e3aba3e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:10.166504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8303-ffe7-4ee1-bf3e-9e883e3aba3e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:10.166504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8303-ffe7-4ee1-bf3e-9e883e3aba3e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:10.167756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 694/1395] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:10.173733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302b6d-cba6-4618-b0cc-bf8f2b3be7e3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:10.174189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302b6d-cba6-4618-b0cc-bf8f2b3be7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:10.174333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302b6d-cba6-4618-b0cc-bf8f2b3be7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:10.194502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c3302b6d-cba6-4618-b0cc-bf8f2b3be7e3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:10.195732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c3302b6d-cba6-4618-b0cc-bf8f2b3be7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:10.212260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 702/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:10.265693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691e79-c977-4e79-a650-7f332d843cd1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:10.266285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691e79-c977-4e79-a650-7f332d843cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:10.266412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691e79-c977-4e79-a650-7f332d843cd1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:10.267816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 695/1397] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 31 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:10.272972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e1c-9472-4d5a-9f0e-6c3d6d5b4837 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:10.273269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e1c-9472-4d5a-9f0e-6c3d6d5b4837 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:10.273561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4e1c-9472-4d5a-9f0e-6c3d6d5b4837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:10.328313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7ebb4e1c-9472-4d5a-9f0e-6c3d6d5b4837 None None] MFA Rules not processed for user `fc9e81f64b024659aea31521c6f5fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:10.329550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7ebb4e1c-9472-4d5a-9f0e-6c3d6d5b4837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:10.392978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 703/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 31 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:10.400329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0691e79-c977-4e79-a650-7f332d843cd1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:10.411722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0691e79-c977-4e79-a650-7f332d843cd1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:10.415559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:10.416271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:10.416477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:10.416821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:10.427161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:10.428579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4347-6a03-4ce3-a312-3b098b59a8c2 service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:10.438147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 696/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:11.104346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749202-d11a-415e-8a15-0919ddfa5725 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.106964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749202-d11a-415e-8a15-0919ddfa5725 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.106964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749202-d11a-415e-8a15-0919ddfa5725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.154661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5b749202-d11a-415e-8a15-0919ddfa5725 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:11.156394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5b749202-d11a-415e-8a15-0919ddfa5725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:11.226594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 704/1400] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:11.270521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0d80-e7c2-49cd-9f50-70b1cf24277d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.271063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0d80-e7c2-49cd-9f50-70b1cf24277d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.271063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b0d80-e7c2-49cd-9f50-70b1cf24277d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.272488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 697/1401] 10.222.0.55 () {54 vars in 942 bytes} [Tue May 31 20:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:11.280375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.281460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.281984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.298412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:11.343714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] MFA Rules not processed for user `8411904e69324169ad7f8907297f650c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:11.344844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:11.404173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b76f-f47a-4c08-b6bf-e612bc2c4977 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.404426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b76f-f47a-4c08-b6bf-e612bc2c4977 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.404694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b76f-f47a-4c08-b6bf-e612bc2c4977 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.406729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 698/1402] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 20:56:11.412085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.412373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.412654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.418198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 705/1403] 10.222.0.55 () {58 vars in 1039 bytes} [Tue May 31 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:11.428537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:11.430512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:11.431709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:11.438341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6235-4375-4387-b4c9-a2fa5e952e12 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:11.439563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 699/1404] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:56:11.443599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:11.444311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.444594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.444867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.454047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:11.455644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c51e-cdd7-4d0c-b42b-e4ecf72e4555 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:11.464237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 706/1405] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 20:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 20:56:11.484781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:11.497662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef633c-fb01-425a-9c40-1d63b718fef6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:11.503067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:11.506705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:11.506705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:11.506705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:11.513027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:11.514547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a7e13-b94a-4fb9-80a5-368c7022d30c service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:11.524968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 700/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:14.081609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a082b-7eee-4ce7-a677-ae416eec212e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:14.082192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a082b-7eee-4ce7-a677-ae416eec212e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:14.082192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a082b-7eee-4ce7-a677-ae416eec212e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:14.083491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 707/1407] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:14.089015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b01-eb70-4402-9c7c-f56cc45b7640 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:14.089473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b01-eb70-4402-9c7c-f56cc45b7640 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:14.089583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b01-eb70-4402-9c7c-f56cc45b7640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:14.108279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cafc0b01-eb70-4402-9c7c-f56cc45b7640 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:14.110732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cafc0b01-eb70-4402-9c7c-f56cc45b7640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:14.118636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 701/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:14.164660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a082b-7eee-4ce7-a677-ae416eec212e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:14.180272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a082b-7eee-4ce7-a677-ae416eec212e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:14.186841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:14.187506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:14.187793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:14.188070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:14.207866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:14.209869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2072a78-f612-46bf-bafc-ee7e8657619d service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:14.222198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 708/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:24.325541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=20 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:24.366338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=53 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:56:35.848616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125791-da78-4f87-a461-985e690c6570 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:35.849152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125791-da78-4f87-a461-985e690c6570 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:35.849152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125791-da78-4f87-a461-985e690c6570 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:35.850560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 702/1410] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 31 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:35.855783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dfdb9-802c-4730-beee-4722d923169c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:35.856194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dfdb9-802c-4730-beee-4722d923169c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:35.856363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dfdb9-802c-4730-beee-4722d923169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:35.875199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ce3dfdb9-802c-4730-beee-4722d923169c None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:35.876450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce3dfdb9-802c-4730-beee-4722d923169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:35.885181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 709/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 31 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:35.900091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8be26f-770e-46cd-a086-85cd9ec70b13 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:35.900382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8be26f-770e-46cd-a086-85cd9ec70b13 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:35.900681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8be26f-770e-46cd-a086-85cd9ec70b13 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:35.902138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 703/1412] 10.222.0.55 () {54 vars in 918 bytes} [Tue May 31 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:35.906797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17b35-ed12-42b8-ad78-6ba46c78b85e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:35.907197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17b35-ed12-42b8-ad78-6ba46c78b85e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:35.907476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c17b35-ed12-42b8-ad78-6ba46c78b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:35.925424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b9c17b35-ed12-42b8-ad78-6ba46c78b85e None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:35.926654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b9c17b35-ed12-42b8-ad78-6ba46c78b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:35.936193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 710/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Tue May 31 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:56:38.655609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed49-386c-4a50-82f4-acfe5a877dc5 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:38.656213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed49-386c-4a50-82f4-acfe5a877dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:38.656213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed49-386c-4a50-82f4-acfe5a877dc5 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:38.657517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:38.662911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665bc8-0fc2-4a1c-90c4-f54289b5365f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:38.663363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665bc8-0fc2-4a1c-90c4-f54289b5365f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:38.663487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665bc8-0fc2-4a1c-90c4-f54289b5365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:38.680933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d1665bc8-0fc2-4a1c-90c4-f54289b5365f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:38.682166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d1665bc8-0fc2-4a1c-90c4-f54289b5365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:38.690902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:38.734134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ed49-386c-4a50-82f4-acfe5a877dc5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:38.748609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97ed49-386c-4a50-82f4-acfe5a877dc5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:38.754258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:38.754903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:38.755183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:38.755454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:38.764375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:38.765992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca92d07-7f85-46f6-a664-b58306dfe4f5 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:38.775291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 705/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:39.746955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552422e-390f-415b-b51a-d98007124f8a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:39.747525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552422e-390f-415b-b51a-d98007124f8a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:39.747525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552422e-390f-415b-b51a-d98007124f8a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:39.749408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:39.754371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9202da-aa4c-49ea-ae19-71ee602d9977 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:39.754811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9202da-aa4c-49ea-ae19-71ee602d9977 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:39.755015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9202da-aa4c-49ea-ae19-71ee602d9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:39.773508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2b9202da-aa4c-49ea-ae19-71ee602d9977 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:39.774734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2b9202da-aa4c-49ea-ae19-71ee602d9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:39.782484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:39.948819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552422e-390f-415b-b51a-d98007124f8a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:39.962905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552422e-390f-415b-b51a-d98007124f8a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:39.968345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:39.968980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:39.969262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:39.969534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:39.978017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:39.979592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539d73-08dc-4711-8976-422da988bc91 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:39.989423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 713/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:40.915024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aef88-2bc3-4f87-9931-71c33f2c5c6c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:40.915586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aef88-2bc3-4f87-9931-71c33f2c5c6c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:40.915586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58aef88-2bc3-4f87-9931-71c33f2c5c6c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:40.916949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:40.921991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504a7e7-994b-41a5-a500-8707c78593ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:40.922415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504a7e7-994b-41a5-a500-8707c78593ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:40.922550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504a7e7-994b-41a5-a500-8707c78593ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:40.940762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0504a7e7-994b-41a5-a500-8707c78593ef None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:40.941990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0504a7e7-994b-41a5-a500-8707c78593ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:40.949708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:41.102483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58aef88-2bc3-4f87-9931-71c33f2c5c6c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:41.117024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58aef88-2bc3-4f87-9931-71c33f2c5c6c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:41.122361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:41.123074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:41.123353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:41.123628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:41.131641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:41.133214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebf35d-e72e-46ba-bc77-e2416533b14d service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:41.142784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 708/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:42.055479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5cc6-44c2-4eb0-a5c3-1178c2fda6a2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:42.055995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5cc6-44c2-4eb0-a5c3-1178c2fda6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:42.055995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5cc6-44c2-4eb0-a5c3-1178c2fda6a2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:42.057347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:42.063010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ec9e-3b40-4094-9177-7ecee15ae2a5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:42.063525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ec9e-3b40-4094-9177-7ecee15ae2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:42.063628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ec9e-3b40-4094-9177-7ecee15ae2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:42.081885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f614ec9e-3b40-4094-9177-7ecee15ae2a5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:42.083116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f614ec9e-3b40-4094-9177-7ecee15ae2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:42.090909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:42.240654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5cc6-44c2-4eb0-a5c3-1178c2fda6a2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:42.255547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5cc6-44c2-4eb0-a5c3-1178c2fda6a2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:42.260857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:42.261497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:42.261779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:42.262087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:42.270138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:42.271707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df9e3-5eb0-4f01-8b49-9ae64492a54d service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:42.281081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 716/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:43.195950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2b67-011b-4184-974f-49ab821b16d7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:43.196499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2b67-011b-4184-974f-49ab821b16d7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:43.196599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2b67-011b-4184-974f-49ab821b16d7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:43.198078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:43.203637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317d65-642d-45e1-9065-d8aaa8477c5f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:43.204096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317d65-642d-45e1-9065-d8aaa8477c5f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:43.204209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a317d65-642d-45e1-9065-d8aaa8477c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:43.222434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a317d65-642d-45e1-9065-d8aaa8477c5f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:43.223634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a317d65-642d-45e1-9065-d8aaa8477c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:43.231736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:43.380959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e2b67-011b-4184-974f-49ab821b16d7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:43.395423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e2b67-011b-4184-974f-49ab821b16d7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:43.400764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:43.401403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:43.401687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:43.401999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:43.410126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:43.411711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cf1ad-e780-4489-b913-14ba7662ac84 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:43.421142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 711/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:44.326843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b3180-3e4e-4d94-bf07-c7a703f17a09 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:44.327370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b3180-3e4e-4d94-bf07-c7a703f17a09 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:44.327482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b3180-3e4e-4d94-bf07-c7a703f17a09 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:44.328800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:44.333765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cd24d-2c6a-42b7-95d1-113b79754f1c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:44.334205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cd24d-2c6a-42b7-95d1-113b79754f1c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:44.334426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cd24d-2c6a-42b7-95d1-113b79754f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:44.352941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-235cd24d-2c6a-42b7-95d1-113b79754f1c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:44.354172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-235cd24d-2c6a-42b7-95d1-113b79754f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:44.361851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:44.508947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b3180-3e4e-4d94-bf07-c7a703f17a09 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:44.531898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b3180-3e4e-4d94-bf07-c7a703f17a09 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:44.538126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:44.539356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:44.539356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:44.539356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:44.548197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:44.549771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdc2b-1b0b-4509-b35a-2902d2b140b6 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:44.559209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 719/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:45.445441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78236-e9b6-4c7f-bdfb-146a7ca911c3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:45.446015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78236-e9b6-4c7f-bdfb-146a7ca911c3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:45.446015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78236-e9b6-4c7f-bdfb-146a7ca911c3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:45.447391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:45.452359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8568c-e345-426f-aa60-a08dc045769f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:45.452803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8568c-e345-426f-aa60-a08dc045769f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:45.452922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8568c-e345-426f-aa60-a08dc045769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:45.472118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-16a8568c-e345-426f-aa60-a08dc045769f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:45.473339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-16a8568c-e345-426f-aa60-a08dc045769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:45.481443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:56:45.628771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e78236-e9b6-4c7f-bdfb-146a7ca911c3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:45.643190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e78236-e9b6-4c7f-bdfb-146a7ca911c3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:45.648501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:45.649148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:45.649430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:45.649707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:45.658321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:45.659901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19496799-cd78-4441-9fce-63d8f5265edb service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:45.669064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 714/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:46.571950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7d64-5fbc-433d-89d0-72ca9c2cb3e3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:46.572494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7d64-5fbc-433d-89d0-72ca9c2cb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:46.572494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7d64-5fbc-433d-89d0-72ca9c2cb3e3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:46.573789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:46.579622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca69b-d17c-4f4c-a4c4-3db1610e46ef None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:46.580040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca69b-d17c-4f4c-a4c4-3db1610e46ef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:46.580167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca69b-d17c-4f4c-a4c4-3db1610e46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:46.597585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a7eca69b-d17c-4f4c-a4c4-3db1610e46ef None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:46.598800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a7eca69b-d17c-4f4c-a4c4-3db1610e46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:46.607217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:46.755874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7d64-5fbc-433d-89d0-72ca9c2cb3e3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:46.769958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7d64-5fbc-433d-89d0-72ca9c2cb3e3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:46.775210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:46.775844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:46.776125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:46.776400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:46.784735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:46.786338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf17bf-0701-484c-8985-5f076da9daa0 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:46.796792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 722/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:47.729090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552574c-0f22-4b52-b735-4981a795a6b2 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:47.729648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552574c-0f22-4b52-b735-4981a795a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:47.729792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552574c-0f22-4b52-b735-4981a795a6b2 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:47.731124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 20:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:47.736147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03348f61-7409-4636-a48a-cc3cd93cdff6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:47.736574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03348f61-7409-4636-a48a-cc3cd93cdff6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:47.736686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03348f61-7409-4636-a48a-cc3cd93cdff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:47.754900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-03348f61-7409-4636-a48a-cc3cd93cdff6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:47.756093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-03348f61-7409-4636-a48a-cc3cd93cdff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:47.764480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:47.910539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552574c-0f22-4b52-b735-4981a795a6b2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:47.924841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552574c-0f22-4b52-b735-4981a795a6b2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:47.930156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:47.930847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:47.931127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:47.931401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:47.939906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:47.941477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd85cd-b878-4516-9fdf-78e74b9df68b service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:47.951274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 717/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:50.045206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c627-e591-44a2-a9a8-50208e9811ef None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:50.045759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c627-e591-44a2-a9a8-50208e9811ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:50.045759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7c627-e591-44a2-a9a8-50208e9811ef None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:50.047071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:50.052429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424511-7b3f-4cc0-8d6a-a7b2075a59cf None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:50.052830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424511-7b3f-4cc0-8d6a-a7b2075a59cf None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:50.053063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424511-7b3f-4cc0-8d6a-a7b2075a59cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:50.070523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9c424511-7b3f-4cc0-8d6a-a7b2075a59cf None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:50.071726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9c424511-7b3f-4cc0-8d6a-a7b2075a59cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:50.079428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:50.118927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7c627-e591-44a2-a9a8-50208e9811ef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:50.129340 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7c627-e591-44a2-a9a8-50208e9811ef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:50.132752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:50.133380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:50.133658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:50.133947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:50.142667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:50.144079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe682f3-d79f-42d6-b761-70e3de5e9f49 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:50.153172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 725/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:52.672468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00f5b-7746-48d0-af3a-92654467dbbd None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:52.673039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00f5b-7746-48d0-af3a-92654467dbbd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:52.673039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f00f5b-7746-48d0-af3a-92654467dbbd None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:52.674432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:52.679780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920024-1449-4e6e-bf48-a72295de8ffb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:52.680185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920024-1449-4e6e-bf48-a72295de8ffb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:52.680344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920024-1449-4e6e-bf48-a72295de8ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:52.697766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-06920024-1449-4e6e-bf48-a72295de8ffb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:52.698984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-06920024-1449-4e6e-bf48-a72295de8ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:52.707244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:52.745431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f00f5b-7746-48d0-af3a-92654467dbbd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:52.756192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f00f5b-7746-48d0-af3a-92654467dbbd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:52.759646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:52.760277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:52.760553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:52.760826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:52.770536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:52.771942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301efdd-b706-43c9-a57b-eacfbad1bcce service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:52.781682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 720/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:55.738388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061277b-6ac2-4a1b-97a2-66d296f13336 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:55.739007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061277b-6ac2-4a1b-97a2-66d296f13336 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:55.739007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061277b-6ac2-4a1b-97a2-66d296f13336 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:55.740508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:55.746166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ad66-85a1-48cc-9382-3ef215bb1754 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:55.746687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ad66-85a1-48cc-9382-3ef215bb1754 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:55.747359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ad66-85a1-48cc-9382-3ef215bb1754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:55.766703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ac78ad66-85a1-48cc-9382-3ef215bb1754 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:55.767921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ac78ad66-85a1-48cc-9382-3ef215bb1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:55.776069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:55.816082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061277b-6ac2-4a1b-97a2-66d296f13336 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:55.829738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061277b-6ac2-4a1b-97a2-66d296f13336 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:55.834261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:55.835031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:55.835324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:55.835602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:55.844968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:55.846619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025a889-9b30-4efc-957c-307398ad5b1d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:55.856627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 728/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:56:58.360426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70a5e-451a-4d49-acb9-301ed474b57b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:58.360992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70a5e-451a-4d49-acb9-301ed474b57b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:58.360992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70a5e-451a-4d49-acb9-301ed474b57b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:58.362419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:56:58.367644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d779-1413-48b8-8226-07384a5da7d0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:58.368077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d779-1413-48b8-8226-07384a5da7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:58.368208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877d779-1413-48b8-8226-07384a5da7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:58.385494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9877d779-1413-48b8-8226-07384a5da7d0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:56:58.386719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9877d779-1413-48b8-8226-07384a5da7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:56:58.394473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:56:58.433131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a70a5e-451a-4d49-acb9-301ed474b57b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:56:58.455532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a70a5e-451a-4d49-acb9-301ed474b57b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:56:58.459130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:56:58.459788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:56:58.460071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:56:58.460351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:56:58.470240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:56:58.471674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c1df-e31a-416c-bdf6-792f80352052 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:56:58.482317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 723/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:00.774662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed8fa-5ae1-44ae-8c23-a2bd92956b01 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:00.775228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed8fa-5ae1-44ae-8c23-a2bd92956b01 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:00.775228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bed8fa-5ae1-44ae-8c23-a2bd92956b01 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:00.776598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:00.782777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccf64-98f5-4ec1-ba2d-5da0eccc2344 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:00.783574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccf64-98f5-4ec1-ba2d-5da0eccc2344 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:00.783862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccf64-98f5-4ec1-ba2d-5da0eccc2344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:00.801966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a86ccf64-98f5-4ec1-ba2d-5da0eccc2344 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:00.803152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a86ccf64-98f5-4ec1-ba2d-5da0eccc2344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:00.811321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:00.849098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bed8fa-5ae1-44ae-8c23-a2bd92956b01 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:00.860310 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bed8fa-5ae1-44ae-8c23-a2bd92956b01 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:00.863720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:00.864348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:00.864628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:00.864903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:00.874101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:00.875520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a158c4-5f35-4694-9223-e6648eb744f7 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:00.884686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 731/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 20:57:03.222447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477922-aee5-4874-90ba-cbb601e7e0c6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:03.222994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477922-aee5-4874-90ba-cbb601e7e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:03.222994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477922-aee5-4874-90ba-cbb601e7e0c6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:03.224637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:03.229951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3909b2-7077-491f-9505-0ffe2c894e96 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:03.230370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3909b2-7077-491f-9505-0ffe2c894e96 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:03.230520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3909b2-7077-491f-9505-0ffe2c894e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:03.251143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8f3909b2-7077-491f-9505-0ffe2c894e96 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:03.252369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8f3909b2-7077-491f-9505-0ffe2c894e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:03.260148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:03.299330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477922-aee5-4874-90ba-cbb601e7e0c6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:03.309796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477922-aee5-4874-90ba-cbb601e7e0c6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:03.313223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:03.313861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:03.314173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:03.314445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:03.323110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:03.325035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20985ded-77a4-49ae-aa21-c255a7c4bc8e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:03.334234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 726/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:05.646192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74587-f99a-4f49-99ec-16128351439d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:05.646715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74587-f99a-4f49-99ec-16128351439d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:05.646715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74587-f99a-4f49-99ec-16128351439d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:05.648075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:05.653342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9438-f8b5-4397-8054-706724899777 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:05.653849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9438-f8b5-4397-8054-706724899777 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:05.653967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9438-f8b5-4397-8054-706724899777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:05.659848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=70 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:05.672226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d20d9438-f8b5-4397-8054-706724899777 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:05.673418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d20d9438-f8b5-4397-8054-706724899777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:05.681145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:05.719177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74587-f99a-4f49-99ec-16128351439d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:05.724690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=73 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:05.731032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74587-f99a-4f49-99ec-16128351439d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:05.734618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:05.735282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:05.735591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:05.735868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:05.744772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:05.746280 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb3905-2b1a-4bcc-ba49-9b1c7d0f7883 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:05.755440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 734/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:08.035702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740dc1c-596b-43bf-a359-3bfa3782d0d0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:08.036232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740dc1c-596b-43bf-a359-3bfa3782d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:08.036345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740dc1c-596b-43bf-a359-3bfa3782d0d0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:08.037641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:08.043721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c21e-02f1-4500-b22c-43408dc3630a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:08.044183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c21e-02f1-4500-b22c-43408dc3630a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:08.044286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c21e-02f1-4500-b22c-43408dc3630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:08.061787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-54b2c21e-02f1-4500-b22c-43408dc3630a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:08.062932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-54b2c21e-02f1-4500-b22c-43408dc3630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:08.070565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:08.108554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740dc1c-596b-43bf-a359-3bfa3782d0d0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:08.119058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740dc1c-596b-43bf-a359-3bfa3782d0d0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:08.122627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:08.123260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:08.123536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:08.123808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:08.132522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:08.133955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaba88-cc81-4abc-85fd-4e07eaf37814 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:08.143142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 729/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:10.464026 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed821f-38c3-4609-b50d-ec6085135bc1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:10.465086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed821f-38c3-4609-b50d-ec6085135bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:10.465086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed821f-38c3-4609-b50d-ec6085135bc1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:10.466455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:10.471643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961cda9-8a38-4953-bfd0-e30d2ffdce2b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:10.472060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961cda9-8a38-4953-bfd0-e30d2ffdce2b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:10.472205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961cda9-8a38-4953-bfd0-e30d2ffdce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:10.491162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1961cda9-8a38-4953-bfd0-e30d2ffdce2b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:10.492357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1961cda9-8a38-4953-bfd0-e30d2ffdce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:10.500026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:10.544013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed821f-38c3-4609-b50d-ec6085135bc1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:10.554440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed821f-38c3-4609-b50d-ec6085135bc1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:10.557952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:10.558586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:10.558864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:10.559137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:10.567799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:10.569210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6d84d-2f09-4ae0-827a-8fce847bc6d2 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:10.578959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 737/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:12.841076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b1142-2524-4f88-b693-e1ad078b9d1e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:12.841638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b1142-2524-4f88-b693-e1ad078b9d1e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:12.841638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b1142-2524-4f88-b693-e1ad078b9d1e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:12.843088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 20:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:12.848684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6f1d-f280-4a50-9d94-d2686f64b356 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:12.849399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6f1d-f280-4a50-9d94-d2686f64b356 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:12.849503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a6f1d-f280-4a50-9d94-d2686f64b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:12.867085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a97a6f1d-f280-4a50-9d94-d2686f64b356 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:12.868322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a97a6f1d-f280-4a50-9d94-d2686f64b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:12.876081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:12.913288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b1142-2524-4f88-b693-e1ad078b9d1e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:12.924199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b1142-2524-4f88-b693-e1ad078b9d1e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:12.927725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:12.928368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:12.928653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:12.928928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:12.937782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:12.939248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd9bac-72d4-4ef6-b007-c7bc202b3679 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:12.948703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 732/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:22.861974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=17 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:22.944500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=17 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:57:44.914695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8119a1-5c70-4aa8-bcbd-f2842fe7f556 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:44.915125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8119a1-5c70-4aa8-bcbd-f2842fe7f556 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:44.915125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8119a1-5c70-4aa8-bcbd-f2842fe7f556 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:44.916575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 739/1471] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:44.922355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bf1f-257f-4693-8d19-f1fcbea269ea None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:44.922874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bf1f-257f-4693-8d19-f1fcbea269ea None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:44.922964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132bf1f-257f-4693-8d19-f1fcbea269ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:44.940931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b132bf1f-257f-4693-8d19-f1fcbea269ea None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:44.942184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b132bf1f-257f-4693-8d19-f1fcbea269ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:44.950813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 733/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:45.004350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a62f-dc69-4e30-9677-a4d62c49c4f6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:45.004350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a62f-dc69-4e30-9677-a4d62c49c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:45.004350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a62f-dc69-4e30-9677-a4d62c49c4f6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:45.004350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 740/1473] 10.222.0.55 () {54 vars in 962 bytes} [Tue May 31 20:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:45.005474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982685-253a-4cbd-8027-4064b096fe81 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:45.005864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982685-253a-4cbd-8027-4064b096fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:45.006275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982685-253a-4cbd-8027-4064b096fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:45.026518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-de982685-253a-4cbd-8027-4064b096fe81 None None] MFA Rules not processed for user `fc9e81f64b024659aea31521c6f5fb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:45.027779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-de982685-253a-4cbd-8027-4064b096fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:45.034301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 734/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Tue May 31 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:45.041793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a62f-dc69-4e30-9677-a4d62c49c4f6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:45.052542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a62f-dc69-4e30-9677-a4d62c49c4f6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:45.056038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:45.057231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:45.057462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:45.057734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:45.066653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:45.068108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd35050-952d-411b-94d4-7145ef24b7aa service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:45.078004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 741/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:47.440636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481051df-d99a-4b74-b117-00948537b4ab None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.441202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481051df-d99a-4b74-b117-00948537b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.441202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481051df-d99a-4b74-b117-00948537b4ab None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.442757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 735/1476] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:47.448087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aecd9-62c1-4f8b-9634-b500654f4e15 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.448519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aecd9-62c1-4f8b-9634-b500654f4e15 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.448647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aecd9-62c1-4f8b-9634-b500654f4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.466109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a58aecd9-62c1-4f8b-9634-b500654f4e15 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:47.467313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a58aecd9-62c1-4f8b-9634-b500654f4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:47.475429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 742/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:47.499823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481051df-d99a-4b74-b117-00948537b4ab None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:47.512759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481051df-d99a-4b74-b117-00948537b4ab None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:47.517150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:47.517806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:47.518112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:47.518390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:47.519122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:47.520852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:57:47.520852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 20:57:47.520852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 20:57:47.522012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f125-543d-4766-a820-3fe0a36f3229 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:47.543022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 736/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Tue May 31 20:57:47 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:57:49.858362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760764c-d2f8-4450-8da7-85bc284bfa3c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:49.858902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760764c-d2f8-4450-8da7-85bc284bfa3c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:49.858902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760764c-d2f8-4450-8da7-85bc284bfa3c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:49.860277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 743/1479] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:49.865617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fffd2-83a2-4482-81ce-ff1698f88560 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:49.866036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fffd2-83a2-4482-81ce-ff1698f88560 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:49.866213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fffd2-83a2-4482-81ce-ff1698f88560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:49.883902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e58fffd2-83a2-4482-81ce-ff1698f88560 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:49.885623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e58fffd2-83a2-4482-81ce-ff1698f88560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:49.893351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 737/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:49.937306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760764c-d2f8-4450-8da7-85bc284bfa3c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:49.952042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760764c-d2f8-4450-8da7-85bc284bfa3c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:49.957420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:49.958091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:49.958381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:49.958659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:49.967682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:49.969265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fd665-682d-45d8-824c-0c770bc00f61 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:49.979401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 744/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:52.409476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b707ac7-4f0b-44ca-8d46-62543fd8817f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:52.410038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b707ac7-4f0b-44ca-8d46-62543fd8817f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:52.410136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b707ac7-4f0b-44ca-8d46-62543fd8817f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:52.411445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 738/1482] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:52.417346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66eda-6b0d-4d61-92cf-bd2e9ec472f2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:52.417801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66eda-6b0d-4d61-92cf-bd2e9ec472f2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:52.417925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66eda-6b0d-4d61-92cf-bd2e9ec472f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:52.435149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2c66eda-6b0d-4d61-92cf-bd2e9ec472f2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:52.436334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2c66eda-6b0d-4d61-92cf-bd2e9ec472f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:52.443979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 745/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:52.480497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b707ac7-4f0b-44ca-8d46-62543fd8817f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:52.491033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b707ac7-4f0b-44ca-8d46-62543fd8817f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:52.494558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:52.495244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:52.495533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:52.495815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:52.504808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:52.506267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591a928-d1e2-481d-a563-9b7e7ad40838 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:52.515530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 739/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:54.846401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897910-b331-4482-ac55-330190c9dd2a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.847375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897910-b331-4482-ac55-330190c9dd2a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.847375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897910-b331-4482-ac55-330190c9dd2a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.848617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 746/1485] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:54.854147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce298-c0ad-4a38-bbb1-e2d328e2b9d2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.854580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce298-c0ad-4a38-bbb1-e2d328e2b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.854717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce298-c0ad-4a38-bbb1-e2d328e2b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.873179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-125ce298-c0ad-4a38-bbb1-e2d328e2b9d2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:54.874445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-125ce298-c0ad-4a38-bbb1-e2d328e2b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:54.882290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 740/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:54.920737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897910-b331-4482-ac55-330190c9dd2a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:54.931818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897910-b331-4482-ac55-330190c9dd2a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:54.935322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:54.935959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:54.936243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:54.936520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:54.945639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:54.947602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fcb4d-be47-46a8-91fe-719299a77c5d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:54.957088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 747/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:57:57.356994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc7c3-7970-44f1-9204-acba2e1ff23b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:57.357600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc7c3-7970-44f1-9204-acba2e1ff23b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:57.357600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc7c3-7970-44f1-9204-acba2e1ff23b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:57.358987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 741/1488] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:57:57.364154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc2ee-bba9-43cb-b5ed-a2b00bdb37da None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:57.364610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc2ee-bba9-43cb-b5ed-a2b00bdb37da None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:57.364719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc2ee-bba9-43cb-b5ed-a2b00bdb37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:57.382853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-97cdc2ee-bba9-43cb-b5ed-a2b00bdb37da None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:57:57.384631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-97cdc2ee-bba9-43cb-b5ed-a2b00bdb37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:57:57.393101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 748/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:57:57.433966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc7c3-7970-44f1-9204-acba2e1ff23b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:57:57.444677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc7c3-7970-44f1-9204-acba2e1ff23b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:57:57.452520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:57:57.453197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:57:57.453482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:57:57.453763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:57:57.463999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:57:57.465464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcb25c-0518-4389-9f01-ac18ce8682ea service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:57:57.475735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 742/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:00.166695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3741b-a4e2-4993-84dd-2cfd6f0eac0f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:00.167215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3741b-a4e2-4993-84dd-2cfd6f0eac0f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:00.167215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3741b-a4e2-4993-84dd-2cfd6f0eac0f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:00.168512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 749/1491] 10.222.0.55 () {54 vars in 926 bytes} [Tue May 31 20:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:58:00.173824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6600-1239-476b-b03d-5b7e0971398e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:00.174289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6600-1239-476b-b03d-5b7e0971398e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:00.174442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6600-1239-476b-b03d-5b7e0971398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:00.192975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-603d6600-1239-476b-b03d-5b7e0971398e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:58:00.194200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-603d6600-1239-476b-b03d-5b7e0971398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:58:00.202252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 743/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Tue May 31 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:58:00.242697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3741b-a4e2-4993-84dd-2cfd6f0eac0f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:58:00.254275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3741b-a4e2-4993-84dd-2cfd6f0eac0f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:58:00.257782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:58:00.258455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:58:00.258793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:58:00.259070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:58:00.268784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:58:00.270252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966c22e-382c-4455-9aa9-2d663260310c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:58:00.280734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 750/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:58:10.187580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=33 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:58:10.275901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=33 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:35.270953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.271739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.271739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.290451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:35.291701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:35.300591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 744/1494] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:35.309355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.309995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.309995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.329451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:35.330721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:35.338657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 751/1495] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 20:59:35.343520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.353615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d897-bb4e-4095-8016-7d7d4e4744c5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.358039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.358697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.358977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.359250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.359976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 20:59:35.360282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.361293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.361293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 20:59:35.361293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 20:59:35.363044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.375045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 745/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 20:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 20:59:35.383451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.399348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd06b6-28ac-4697-baa3-6c30f7a43d5d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.403975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.404637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.404921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.405196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.405974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.407715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.407715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 20:59:35.407715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 20:59:35.409497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.509717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 752/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 20:59:35 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 20:59:35.513965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.524785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63a134-7779-4179-be2f-aaf7286c411d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.583138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.583863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.584161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.584429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.585145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.586215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.586215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 20:59:35.586215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 20:59:35.587451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.703311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 746/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 20:59:35 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 20:59:35.708121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.718972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3674c-a237-4a65-a9ee-8e6f6ce66bdc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.724194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.724881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.725168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.725450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.726320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.727351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.727351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 20:59:35.727351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 20:59:35.728235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.741021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 753/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:35.745089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.755479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5643f87-259d-42f4-91cf-3a7c394d0042 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.760119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.760782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.761063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.761341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.762106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.763118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.763118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 20:59:35.763118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 20:59:35.763994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f8f5-5fd2-4020-af16-3cb076794010 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.778829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 747/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 20:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 20:59:35.783018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:35.794257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bf6e7-4f20-4754-9c25-2d212630e71d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:35.798978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:35.799898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.800183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.800465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] PATH_INFO: `/v3/projects/5d25674672d14148a902857ee299b975/users/04a77710ea114de998a02631e0cae512/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.817521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d25674672d14148a902857ee299b975, user_id=04a77710ea114de998a02631e0cae512, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:35.818619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:35.818619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 20:59:35.818619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 20:59:35.820560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73743-85df-49d5-8e46-77bc7e5420f3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:35.888084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 754/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 20:59:35 2022] PUT /identity/v3/projects/5d25674672d14148a902857ee299b975/users/04a77710ea114de998a02631e0cae512/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:35.901043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a613-5b93-4c8e-9115-d95eaa29ab08 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:35.901356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a613-5b93-4c8e-9115-d95eaa29ab08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:35.901639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a613-5b93-4c8e-9115-d95eaa29ab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:35.928210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2c87a613-5b93-4c8e-9115-d95eaa29ab08 None None] MFA Rules not processed for user `04a77710ea114de998a02631e0cae512`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:35.929427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2c87a613-5b93-4c8e-9115-d95eaa29ab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:35.994771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 748/1502] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:36.008678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c344a-f49a-44b4-b24d-085043bb19dc None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.008970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c344a-f49a-44b4-b24d-085043bb19dc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.009246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c344a-f49a-44b4-b24d-085043bb19dc None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.010708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 755/1503] 10.222.0.55 () {54 vars in 963 bytes} [Tue May 31 20:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:36.015875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cee32-4e64-412c-a3a6-4b91817a1fc2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.016158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cee32-4e64-412c-a3a6-4b91817a1fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.016496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cee32-4e64-412c-a3a6-4b91817a1fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.036434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a41cee32-4e64-412c-a3a6-4b91817a1fc2 None None] MFA Rules not processed for user `0773ba9f520f432c88ae86143c91b9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:36.037547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a41cee32-4e64-412c-a3a6-4b91817a1fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:36.083272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:36.095503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 749/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Tue May 31 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:36.104925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c344a-f49a-44b4-b24d-085043bb19dc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:36.116318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c344a-f49a-44b4-b24d-085043bb19dc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:36.119832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:36.120474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.120756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.121033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.130651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:36.132939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:36.141359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 756/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:36.188954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b6a5-6c10-4cd0-9b8a-4fedff0b948d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.189264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b6a5-6c10-4cd0-9b8a-4fedff0b948d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.189551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b6a5-6c10-4cd0-9b8a-4fedff0b948d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.191662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 750/1506] 10.222.0.55 () {52 vars in 829 bytes} [Tue May 31 20:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 20:59:36.195699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:36.260170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b4549-21ee-4c32-aa0c-0efd00d015d1 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:36.265019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:36.265915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.266209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.266498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] PATH_INFO: `/v3/users/04a77710ea114de998a02631e0cae512` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.267715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a77710ea114de998a02631e0cae512)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:36.268752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:36.268752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 20:59:36.268752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 20:59:36.270223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:36.515721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a77710ea114de998a02631e0cae512'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:36.536346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a77710ea114de998a02631e0cae512'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:36.537174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a77710ea114de998a02631e0cae512'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:36.558084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a77710ea114de998a02631e0cae512'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:36.558084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a77710ea114de998a02631e0cae512'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:36.558084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:36.650986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 757/1507] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 20:59:36 2022] DELETE /identity/v3/users/04a77710ea114de998a02631e0cae512 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:36.655646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.656174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.656279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.675352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 20:59:36.676579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:36.735623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 751/1508] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 20:59:36.746506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:36.747936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:36.804847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292705ed-855e-4eb7-8fe0-228616411d2c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:36.808515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:36.809111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:36.809395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:36.809671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:36.818725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:36.820174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b75ac-204b-482c-aed5-60f70bd92309 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:36.829912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 758/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 20:59:37.289274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 20:59:37.290747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 20:59:37.303069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6face490-5bd2-415d-aa9a-83a01ada5fa0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 20:59:37.307644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 20:59:37.308526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 20:59:37.308810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 20:59:37.309123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] PATH_INFO: `/v3/projects/5d25674672d14148a902857ee299b975` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 20:59:37.310373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d25674672d14148a902857ee299b975)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 20:59:37.311415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 20:59:37.311415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 20:59:37.311415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 20:59:37.312596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 20:59:37.447471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d25674672d14148a902857ee299b975', 'request_id': 'req-bffa6e83-4e2e-454b-a699-39ffda7df90f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:37.462062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d25674672d14148a902857ee299b975', 'request_id': 'req-bffa6e83-4e2e-454b-a699-39ffda7df90f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:37.468536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d25674672d14148a902857ee299b975', 'request_id': 'req-bffa6e83-4e2e-454b-a699-39ffda7df90f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:37.561569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] The token cache is being invalidate because project 5d25674672d14148a902857ee299b975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 20:59:37.561861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:37.562622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bffa6e83-4e2e-454b-a699-39ffda7df90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 20:59:37.564195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 752/1510] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 20:59:37 2022] DELETE /identity/v3/projects/5d25674672d14148a902857ee299b975 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 20:59:46.825411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 20:59:47.558503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:14.775089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:14.775683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:14.775683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:14.777024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 21:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:14.782157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6325-e2ec-47f8-b52e-e439394452c0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:14.782653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6325-e2ec-47f8-b52e-e439394452c0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:14.782807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6325-e2ec-47f8-b52e-e439394452c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:14.801410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e38a6325-e2ec-47f8-b52e-e439394452c0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:14.802714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e38a6325-e2ec-47f8-b52e-e439394452c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:14.865868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:15.041241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:15.043074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:15.127645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18282b-d676-4232-9143-64c23e1d92df None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:15.133202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:15.133866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:15.134166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:15.134443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:15.143793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:15.145397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a904e4-b476-48b3-9698-dfb0a9911d47 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:15.156256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 760/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:16.085664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad74af-978b-4144-85c0-2db82e2d67e5 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.086234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad74af-978b-4144-85c0-2db82e2d67e5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.086234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad74af-978b-4144-85c0-2db82e2d67e5 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.087603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 21:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:16.093151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8878-1df2-4346-a910-81e1bc1b97be None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.093707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8878-1df2-4346-a910-81e1bc1b97be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.093707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8878-1df2-4346-a910-81e1bc1b97be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.111981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-340b8878-1df2-4346-a910-81e1bc1b97be None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:16.113189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-340b8878-1df2-4346-a910-81e1bc1b97be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:16.121209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:16.276536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad74af-978b-4144-85c0-2db82e2d67e5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:16.297017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad74af-978b-4144-85c0-2db82e2d67e5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:16.303260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:16.303927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.304215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.304607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.314199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:16.315774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fea7f4-6951-44d5-81c3-37afc3364833 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:16.326748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 755/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:16.844989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891973-783a-417e-9bfa-4ec0ace69ce9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.845332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891973-783a-417e-9bfa-4ec0ace69ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.845732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891973-783a-417e-9bfa-4ec0ace69ce9 None None] PATH_INFO: `/v3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.847319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 762/1517] 10.222.0.40 () {54 vars in 925 bytes} [Tue May 31 21:01:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:01:16.854205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15aa5-cb1b-4583-9497-ed5f3bac27ea None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:16.854555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15aa5-cb1b-4583-9497-ed5f3bac27ea None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:16.854885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c15aa5-cb1b-4583-9497-ed5f3bac27ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:16.875279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b8c15aa5-cb1b-4583-9497-ed5f3bac27ea None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:16.876520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b8c15aa5-cb1b-4583-9497-ed5f3bac27ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:16.944293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 756/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Tue May 31 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:21.185931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316673-a5d5-4806-bb01-8e0496a1e309 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.186989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316673-a5d5-4806-bb01-8e0496a1e309 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.186989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316673-a5d5-4806-bb01-8e0496a1e309 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.188363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 763/1519] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 31 21:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:21.195312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50c1d-9e04-402b-b13a-3e284421583a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.195789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50c1d-9e04-402b-b13a-3e284421583a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.195883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50c1d-9e04-402b-b13a-3e284421583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.218675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8ad50c1d-9e04-402b-b13a-3e284421583a None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:21.220766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8ad50c1d-9e04-402b-b13a-3e284421583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:21.235312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 757/1520] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 31 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:21.242999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316673-a5d5-4806-bb01-8e0496a1e309 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:21.257434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316673-a5d5-4806-bb01-8e0496a1e309 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:21.262980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:21.263185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:21.263362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:21.263642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:21.273039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:21.274701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee72da7-35e2-4bd5-8edc-3f261bf1179c service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:21.285201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 764/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:27.669448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11412-e22c-40a5-8899-2dee42dbb28a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:27.670091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11412-e22c-40a5-8899-2dee42dbb28a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:27.670502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11412-e22c-40a5-8899-2dee42dbb28a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:27.673121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 21:01:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:27.679274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137373fc-c174-46e7-bb7e-3fa8aee96b73 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:27.679828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137373fc-c174-46e7-bb7e-3fa8aee96b73 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:27.679828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137373fc-c174-46e7-bb7e-3fa8aee96b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:27.699366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-137373fc-c174-46e7-bb7e-3fa8aee96b73 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:27.700563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-137373fc-c174-46e7-bb7e-3fa8aee96b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:27.709045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:27.864835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b11412-e22c-40a5-8899-2dee42dbb28a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:27.880221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b11412-e22c-40a5-8899-2dee42dbb28a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:27.885829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:27.886512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:27.886841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:27.887068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:27.895839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:27.897328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817626f-f82e-4ffd-8686-36bb890b1a57 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:27.906878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 759/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:28.793690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06681-350f-4ba9-9163-a49b99527b87 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:28.794256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06681-350f-4ba9-9163-a49b99527b87 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:28.794256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06681-350f-4ba9-9163-a49b99527b87 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:28.795551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:28.800992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478473-a3bb-4d4f-8122-a05bbc0c8d24 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:28.801652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478473-a3bb-4d4f-8122-a05bbc0c8d24 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:28.801652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4478473-a3bb-4d4f-8122-a05bbc0c8d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:28.820993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a4478473-a3bb-4d4f-8122-a05bbc0c8d24 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:28.822249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a4478473-a3bb-4d4f-8122-a05bbc0c8d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:28.836409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:28.989580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06681-350f-4ba9-9163-a49b99527b87 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:29.007475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06681-350f-4ba9-9163-a49b99527b87 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:29.012817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:29.013493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:29.013774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:29.014081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:29.023493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:29.025090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964e809-de83-490b-9cfd-4917ae0a7f52 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:29.036061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 767/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:33.160046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.160657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.160657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.161935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 21:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:33.168019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd1694-7d00-439d-835b-46e9f18fb0cb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.168608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd1694-7d00-439d-835b-46e9f18fb0cb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.168608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd1694-7d00-439d-835b-46e9f18fb0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.187254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-01bd1694-7d00-439d-835b-46e9f18fb0cb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:33.188485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-01bd1694-7d00-439d-835b-46e9f18fb0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:33.196682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:33.235169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:33.236924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:33.303185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ff0b1-9df8-4106-ad65-b8ccb1456656 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:33.306923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:33.307595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:33.307875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:33.308153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:33.318429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:33.319862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6a23-690c-41bf-b8ea-ce3007000f6d service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:33.324987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:33.330071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 762/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:35.688113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46d41-47f9-428d-a8fe-994a6a688522 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:35.688765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46d41-47f9-428d-a8fe-994a6a688522 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:35.688765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46d41-47f9-428d-a8fe-994a6a688522 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:35.690101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:35.696126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f2e7-f643-4c86-8457-1545e4224d19 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:35.696689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f2e7-f643-4c86-8457-1545e4224d19 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:35.696689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f2e7-f643-4c86-8457-1545e4224d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:35.716646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9c11f2e7-f643-4c86-8457-1545e4224d19 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:35.717942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9c11f2e7-f643-4c86-8457-1545e4224d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:35.726308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:01:35.763081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad46d41-47f9-428d-a8fe-994a6a688522 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:35.775527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad46d41-47f9-428d-a8fe-994a6a688522 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:35.779647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:35.782416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:35.782416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:35.782416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:35.791386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:35.792870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022535e-9f39-443a-819b-c4cc3bee99d2 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:35.804058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 770/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:39.866235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.866854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.866854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.868239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 21:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:39.874421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433e86-f265-41c4-be4d-03c0bf38fb29 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:39.874947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433e86-f265-41c4-be4d-03c0bf38fb29 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:39.875053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433e86-f265-41c4-be4d-03c0bf38fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:39.881380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=62 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:39.900917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8f433e86-f265-41c4-be4d-03c0bf38fb29 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:39.903029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8f433e86-f265-41c4-be4d-03c0bf38fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:39.916670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:40.207278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:40.210445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:40.312743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d5f56-f540-4d75-987d-193c61c49450 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:40.316584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:40.317271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:40.317552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:40.317828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:40.328801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:40.330294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07470002-f492-4ef3-936a-1ccfae0822d2 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:40.341952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 765/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:01:42.700423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:42.701605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:42.701605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:42.702955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:01:42.708480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2ef2-f843-40cc-abc5-62e8093fef77 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:42.709294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2ef2-f843-40cc-abc5-62e8093fef77 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:42.709294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2ef2-f843-40cc-abc5-62e8093fef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:42.730190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-888b2ef2-f843-40cc-abc5-62e8093fef77 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:01:42.731433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-888b2ef2-f843-40cc-abc5-62e8093fef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:42.740148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:01:43.017244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:01:43.019005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:01:43.032693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ba40-a9b5-409a-83ba-d6f2ac082353 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:01:43.036130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:01:43.036796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:01:43.037078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:01:43.037351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:01:43.047530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:01:43.048988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198aaee-336d-46b0-9e42-38c7790639e9 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:01:43.061475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 773/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:01:52.724105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=32 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:01:53.054612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:13.872176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:13.872762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:13.872762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:13.902951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:13.904180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:13.913284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 767/1540] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:13.923273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:13.923833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:13.923833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:13.946772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:13.947981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:13.962938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 774/1541] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:13.967948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:13.979138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04bb2-2bc1-4d50-a72b-38c0dfd75c45 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:13.989425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:13.990149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:13.990434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:13.990711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:13.991466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:13.991826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:13.993486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.016628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 768/1542] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:14.026279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.040604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239923b-9be0-4438-9cfc-9bbd620b820b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.050707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.051430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.051729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.052018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.052819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.055429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a51fb-798f-48d6-bc9a-7b16eb8af7d3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.200418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 775/1543] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:14.205191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.222954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c064c-b18b-4163-8d0d-3e540499bd9f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.301753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb7291-2e1b-4b78-9a81-261d946e750e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.302148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb7291-2e1b-4b78-9a81-261d946e750e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.302358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb7291-2e1b-4b78-9a81-261d946e750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.316855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.318004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.318536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.319038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.320373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.322647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.343956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0ebb7291-2e1b-4b78-9a81-261d946e750e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.350164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0ebb7291-2e1b-4b78-9a81-261d946e750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.365423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 776/1544] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.380266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abf71b-73d0-41c7-b8db-36d9ad75d28a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.383303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abf71b-73d0-41c7-b8db-36d9ad75d28a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.383303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abf71b-73d0-41c7-b8db-36d9ad75d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.415308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b7abf71b-73d0-41c7-b8db-36d9ad75d28a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.416712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7abf71b-73d0-41c7-b8db-36d9ad75d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.427179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 777/1545] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.433260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.433587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.433942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.468519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.468519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.475058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 769/1546] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:14.478253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.495142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 778/1547] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.496493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.508703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950c15-1087-43ed-be86-5cf61d95a4d8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.520497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4b957-4221-4056-bc87-23c4c30ed159 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.521538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.522681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.523869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.524386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.525423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:14.526130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.531036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbac2b-d0e5-419c-8695-bdebcc8a0693 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.534685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.538030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.538030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.538030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.538030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.539133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e7c26-cc6c-49d5-a09b-958015d9d3b1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.566741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 770/1548] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:14.568209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 779/1549] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:14.568353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.568576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.568861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.570407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.570707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.570981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.609298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.611112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.620153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.621431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.634768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 771/1550] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.635796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.647546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 780/1551] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.649023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.664528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408076c-4d7e-4bd5-94c2-7f03cec5cc11 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.665132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e465f7-717f-4621-acf7-279f5de161a1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.670588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.670986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.671695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.671982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.672261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.672573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.673018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.673301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.673789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.674760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.674892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f004f-1007-4e52-aaf7-caa58136178b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.677089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.689118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 772/1552] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:14.691829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.692131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.692422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.718193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.719829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.729524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 773/1553] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.730484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.742470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642f2f-3024-435b-aba4-38562b2e9515 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.748210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.749950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.749950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.749950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.750296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:14.750593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.752196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836d6dd-f981-455e-b97f-b794fae3493c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.765946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 774/1554] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:14.767387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de13e6-af9a-4558-aaa2-869f42fb8c7d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.767672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de13e6-af9a-4558-aaa2-869f42fb8c7d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.767959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de13e6-af9a-4558-aaa2-869f42fb8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.788018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-23de13e6-af9a-4558-aaa2-869f42fb8c7d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.792414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-23de13e6-af9a-4558-aaa2-869f42fb8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.798730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 775/1555] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.800073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e18-8d7d-4c8e-8f78-d72bb80c0e94 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.800408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e18-8d7d-4c8e-8f78-d72bb80c0e94 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.800693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e18-8d7d-4c8e-8f78-d72bb80c0e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.821822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 781/1556] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:14.821822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.826337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-dbd79e18-8d7d-4c8e-8f78-d72bb80c0e94 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.827563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dbd79e18-8d7d-4c8e-8f78-d72bb80c0e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.887154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde374-1dc5-4703-971e-1022e8ed6947 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.890750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 776/1557] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.892079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929da627-c596-4979-b74a-acced164ce08 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.892368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929da627-c596-4979-b74a-acced164ce08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.892651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929da627-c596-4979-b74a-acced164ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.895382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.896319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.896614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.896902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] PATH_INFO: `/v3/projects/979727d273dc44faa7861e084aea2022/users/f1b9a99fb432495aa5f4d0402a7858ff/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.910892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-929da627-c596-4979-b74a-acced164ce08 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.912103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-929da627-c596-4979-b74a-acced164ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.913222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=979727d273dc44faa7861e084aea2022, user_id=f1b9a99fb432495aa5f4d0402a7858ff, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.916029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49428d86-4549-466f-b4ec-c6de042b5f5b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:14.920225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 777/1558] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.921356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.921648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.921989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.934522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:14.940392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:14.941605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:14.950124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 778/1559] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:14.950907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:14.960869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2f8c-329e-486b-8d92-8fb25bd6090f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:14.966144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:14.966816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:14.967106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:14.967383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:14.968084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:14.969120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:14.969120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 21:03:14.969120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 21:03:14.972155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.016122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 782/1560] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:14 2022] PUT /identity/v3/projects/979727d273dc44faa7861e084aea2022/users/f1b9a99fb432495aa5f4d0402a7858ff/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:15.018103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109995d-32f5-49a4-a349-92b686c958f9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.018650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109995d-32f5-49a4-a349-92b686c958f9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.019005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109995d-32f5-49a4-a349-92b686c958f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.038354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1109995d-32f5-49a4-a349-92b686c958f9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:15.040289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1109995d-32f5-49a4-a349-92b686c958f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:15.091904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:15.104046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 783/1561] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:15.105433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.105725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.106125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.126585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:15.127915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:15.134312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 779/1562] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:14 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:15.134312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.198752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 784/1563] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:15.199639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.209767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cc1f-98e1-4a7f-a060-b6ecfea72774 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.215159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.215816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.216255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.216387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d068dd-8c66-48a6-bf5e-2de6502e91b3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.216546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.217336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:15.217652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.218724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:15.218724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 21:03:15.218724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 21:03:15.219608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad4a0-526e-4be2-be1a-2a0b5cb477b4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.223524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.224351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.224499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.224779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.225491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.228203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.232683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 785/1564] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:15.234043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.234342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.234618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.257377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:15.258867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:15.268115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 786/1565] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:15.269188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.279746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ca5e8-5698-43e0-81b8-bfb14164e2fc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.285225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.286182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.286602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.287015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.287925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:15.288270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.290932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43fba7-6b39-47cd-a964-697bbd544310 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.310548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 787/1566] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:15.312865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38925-547b-4fb7-abba-32f05eaab4ee None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.313373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38925-547b-4fb7-abba-32f05eaab4ee None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.313877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38925-547b-4fb7-abba-32f05eaab4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.353476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5ae38925-547b-4fb7-abba-32f05eaab4ee None None] MFA Rules not processed for user `f1b9a99fb432495aa5f4d0402a7858ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:15.354787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5ae38925-547b-4fb7-abba-32f05eaab4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:15.430960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 788/1567] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:15.432395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.432682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.432957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.443963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 780/1568] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:15.445305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.458418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:15.461314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b887-c52d-4365-9244-8ace21431fc7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.461575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:15.468410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.469185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.469380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.469722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.470783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.472828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.478288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 789/1569] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:15.478288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.496865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269c89-b9ce-4afc-b8a7-8730c163bae6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.504830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.505723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.512240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.512240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.512240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:15.512240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.512240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.526000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 790/1570] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:15.527232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.539750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bceb64-7b72-4d8b-94e8-3af7196c050c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.544641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.545324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.545608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.545917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.546639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.548582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.606734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 781/1571] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:15.607591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.618301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9dbc0-ab78-4b5b-a636-1b6cf804f98e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.623063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.623754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.624044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.624314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.625081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:15.625386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.627047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.641348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 782/1572] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:15.642228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.652693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e31d-767d-46a8-b228-da587bde8319 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.656991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 791/1573] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:15.657867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.659188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.660643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.661100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.661533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.662553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.665570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.676750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:15.737528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47017c2-57b0-4cad-ae8b-ebc60087e111 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.742554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db377b-fce7-4339-9024-264322599abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.743265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db377b-fce7-4339-9024-264322599abc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.743551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db377b-fce7-4339-9024-264322599abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.743832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db377b-fce7-4339-9024-264322599abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.744599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db377b-fce7-4339-9024-264322599abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.746405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db377b-fce7-4339-9024-264322599abc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.758425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 792/1574] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:15.759877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982776af-f313-4ad4-b1f2-5a986ac967ec None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.760174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982776af-f313-4ad4-b1f2-5a986ac967ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.760457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982776af-f313-4ad4-b1f2-5a986ac967ec None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.761887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 793/1575] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 31 21:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:15.762730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982776af-f313-4ad4-b1f2-5a986ac967ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.776756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 783/1576] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:15.780808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.781877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982776af-f313-4ad4-b1f2-5a986ac967ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.923897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.924488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3be5e-3039-4863-a3ce-b6a3c90b90db admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.924948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.924948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.925158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.926032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:15.926357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.928111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.929926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.930603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.930887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.931162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.931871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.933792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.941151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 794/1577] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:15.942032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.959677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c320-2c6d-4772-b196-006bd7055ea4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:15.965722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:15.966439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:15.966723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:15.967004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:15.967827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:15.969538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:15.984141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 795/1578] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:15.985013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:15.999799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1d8a-445c-4ea6-830d-7146a90c1113 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.000114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.000780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.001071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.001346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.002087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.004040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.023679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:16.031437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 784/1579] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.040427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.100339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 796/1580] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:15 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.101388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ea48e-6f31-4183-ad7d-b82d51074779 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.102543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.179436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdac2-e106-4030-9970-5871a6ef33d2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.181637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.182353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.182641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.182921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.183666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.184047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.184871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.185165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.185440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.185752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.186249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.187881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2e589-422e-4273-831a-03cdaeec0d86 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.199716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 797/1581] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:16.201251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.201804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.202152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.210804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:16.222881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:16.224123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:16.302220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 798/1582] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:16.303384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.315902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 785/1583] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.316912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.317457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c37cd-dbe5-4389-9244-a23419d6441d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.326326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.327448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.327955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.328723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.330168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.330416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872889b-c366-4a61-b823-5049d08427c7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.331915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:16.331915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 21:03:16.331915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 21:03:16.334414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.335878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.336540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.336822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.337100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.337800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.339951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.443173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 799/1584] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.444077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.445757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 786/1585] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.446707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.456111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b01b0e-ce35-4e2c-ba2b-a45ba542d27c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.512253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbbb6e-94a3-41ae-aed3-4e7df29df54a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.513336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.514055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.514341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.514659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.515354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.516955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.517620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.518321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.518601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.518879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.519570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.521497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.527665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 800/1586] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:16.528544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.538787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7af2-ba88-49c6-abe7-b2debfeb8f86 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.543758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.549460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.549460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.549460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.549460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.549460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.685474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 787/1587] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.686197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 801/1588] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:16.686982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.687755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.696855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:16.701213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee62c5-5bd4-4a92-876e-5cd3e06b0f7a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.706654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.707661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.707940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.708216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] PATH_INFO: `/v3/projects/96f91ac37f864ed98a03f9082252e334/users/d5b358c38b5a44d798f7f53c4b318134/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.726162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f91ac37f864ed98a03f9082252e334, user_id=d5b358c38b5a44d798f7f53c4b318134, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.727513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:16.727513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 21:03:16.727513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 21:03:16.729529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.750462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:16.767435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6bbaf-4df3-4120-92e6-090487458112 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.773807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.774704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.775137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.775922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.816578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 788/1589] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:16 2022] PUT /identity/v3/projects/96f91ac37f864ed98a03f9082252e334/users/d5b358c38b5a44d798f7f53c4b318134/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:16.818169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.862431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.864088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.875571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 802/1590] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:16.876446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.887962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a94889-e9e0-4a03-b1cf-16c4fbdb5957 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.894406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.895389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.895706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.896047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.896803 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.898276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce96a3-549f-4258-98f0-1df983e6a481 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.898771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.905602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.905791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.913851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.913851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.913851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.913851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.914251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 803/1591] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:16.914251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.920484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 789/1592] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:16.921211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:16.926724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719cdc-72bc-4381-b62d-d2a8dd373510 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.933085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76121-9d40-485d-9e30-e952317b7884 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:16.935084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.935084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.935084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.935084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.935435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.936882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:16.938385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:16.939438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:16.939786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:16.940208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] PATH_INFO: `/v3/projects/514e3c731ce34db584cf832e0f95d1fe/users/f8f62f4151e744018155322bc669d06b/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:16.957572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514e3c731ce34db584cf832e0f95d1fe, user_id=f8f62f4151e744018155322bc669d06b, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:16.960464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c578f03-3fde-4ce9-964b-75879ead8c89 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.033869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 804/1593] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:16 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:17.034835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.044726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50e49-47b7-49da-bbcf-bd0523983d64 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.049685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.050382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.050668 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.050944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.051676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.053276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.067405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 805/1594] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.068359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.083383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 790/1595] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:16 2022] PUT /identity/v3/projects/514e3c731ce34db584cf832e0f95d1fe/users/f8f62f4151e744018155322bc669d06b/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:17.083383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.083383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.083383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.090499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc6f5-cbb8-43f5-a016-3398badb47c1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.097388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:17.098775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.157024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.157851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.158170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.158769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.159260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.160876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.165346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 791/1596] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:17.166311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.172846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 806/1597] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.173827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.179051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdac2f-1364-4b7a-97ee-d47af4f94356 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.184602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.185383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15558f3-0838-4cad-9761-c10f906c2280 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.185522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.185650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.185939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.186827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.188431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.190455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.191138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.191421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.191725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.192471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.194176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.205284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 792/1598] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.205284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.209049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 807/1599] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.209049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.214999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7796f9-14d8-4601-890b-d0a2171c3c8c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.219297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d18276-5b4d-4c0a-b258-f9b8a836017a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.219668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.220341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.220623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.220893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.221657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.223292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a1f3a-1052-4102-94a0-b55576354d3a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.224722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.225542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.226525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.226847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.227731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.229550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24e84-a135-4129-8a82-79d82b456c2c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.234597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 793/1600] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.235998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.236357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.236708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.242876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 808/1601] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.244221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8d4c-8a5a-4f74-9dd0-397367d1732a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.244514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8d4c-8a5a-4f74-9dd0-397367d1732a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.244790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8d4c-8a5a-4f74-9dd0-397367d1732a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.246193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 809/1602] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 31 21:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:17.246982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8d4c-8a5a-4f74-9dd0-397367d1732a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.269726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8d4c-8a5a-4f74-9dd0-397367d1732a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.270969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] MFA Rules not processed for user `f8f62f4151e744018155322bc669d06b`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:17.271502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.278029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.279154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.279632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.280101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.281715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.283035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.291986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.295546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 810/1603] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.296427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.298336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.318931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.338982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 794/1604] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:17.339892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.350261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ebd69-9c7c-458d-84b1-53064df8dfbe None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.356094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.357024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.357968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.357968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] PATH_INFO: `/v3/projects/b5cb073f2b5a4019bd4dfac0d0abe4ab/users/f672f992aea84b44b92ed22ba602b21c/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.359257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8f1ea-409b-4326-ab24-f2f3df98c4a1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.363641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.364706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.365606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.366172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.375778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cb073f2b5a4019bd4dfac0d0abe4ab, user_id=f672f992aea84b44b92ed22ba602b21c, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.378106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.379422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.380919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.393721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 811/1605] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:17.394566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.403413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0236211-bd97-4f6d-87ef-d312dfc004be service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.407977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.408916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.409198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.409471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] PATH_INFO: `/v3/projects/f1b54ceb69fc4041b743a11eda4144a8/users/bbf377756836405d804d2aaba6e44c1f/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.426255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b54ceb69fc4041b743a11eda4144a8, user_id=bbf377756836405d804d2aaba6e44c1f, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.429501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.497111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 795/1606] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:17 2022] PUT /identity/v3/projects/b5cb073f2b5a4019bd4dfac0d0abe4ab/users/f672f992aea84b44b92ed22ba602b21c/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:17.498093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.530018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 812/1607] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:17 2022] PUT /identity/v3/projects/f1b54ceb69fc4041b743a11eda4144a8/users/bbf377756836405d804d2aaba6e44c1f/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:17.534459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.572996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bf00-0f54-4c54-83e8-61511a4962b3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.608755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664a09-34b9-41c4-84c0-18266c3795fb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.613632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.614934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.615278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.615623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] PATH_INFO: `/v3/projects/850d5d523656499e85e63dd1a5e72857/users/b39d1cd331d846538ee5bd4a8170b5dc/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.634469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=850d5d523656499e85e63dd1a5e72857, user_id=b39d1cd331d846538ee5bd4a8170b5dc, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.637609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.650106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.650797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.651079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.651355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.652090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.653682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4280561-7d15-44ac-bd8d-b54c8fb88850 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.663902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 796/1608] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:17.665296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068b95c-f38b-4080-8ec8-367f85877e2b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.665596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068b95c-f38b-4080-8ec8-367f85877e2b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.665876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068b95c-f38b-4080-8ec8-367f85877e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.685243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c068b95c-f38b-4080-8ec8-367f85877e2b None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:17.686502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c068b95c-f38b-4080-8ec8-367f85877e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.742002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 813/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:17 2022] PUT /identity/v3/projects/850d5d523656499e85e63dd1a5e72857/users/b39d1cd331d846538ee5bd4a8170b5dc/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:17.742002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.743285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:17.796880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 797/1610] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:17.798434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226158-7e2b-427d-a799-1f12ea60bbc7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.798797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226158-7e2b-427d-a799-1f12ea60bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.799262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226158-7e2b-427d-a799-1f12ea60bbc7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.800993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 798/1611] 10.222.0.55 () {54 vars in 961 bytes} [Tue May 31 21:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:17.802780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea42c7-b662-4d51-b264-e968b4c1825f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.803194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea42c7-b662-4d51-b264-e968b4c1825f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.803436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea42c7-b662-4d51-b264-e968b4c1825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.831910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fd8d-9147-4eb6-8a70-fce0b600f89a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.836470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-64ea42c7-b662-4d51-b264-e968b4c1825f None None] MFA Rules not processed for user `f672f992aea84b44b92ed22ba602b21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:17.838408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64ea42c7-b662-4d51-b264-e968b4c1825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.844065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.845261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.845699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.846397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] PATH_INFO: `/v3/projects/180ff6fd8c5b434abffa058ea99ef7c4/users/92d56ad8d4ab4c1099263a3d1c43490a/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.866916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180ff6fd8c5b434abffa058ea99ef7c4, user_id=92d56ad8d4ab4c1099263a3d1c43490a, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.869606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcad289-4910-4a48-b922-18e83582cce8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:17.914484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 799/1612] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:17.915882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.916247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.916609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.934784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:17.935985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:17.943759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 800/1613] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:17.945203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:17.955130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5ccae-5933-429e-b7e1-eee35a19e298 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:17.959812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:17.960709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:17.960990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:17.961262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] PATH_INFO: `/v3/projects/af420d43367c42e4a4b0948706dd0546/users/2d69edafe80649d4aff602b692e294c8/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:17.976593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=af420d43367c42e4a4b0948706dd0546, user_id=2d69edafe80649d4aff602b692e294c8, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:17.979313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb7eb4-169e-48ad-a97c-43dc57faa5de admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.093401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 814/1614] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:17 2022] PUT /identity/v3/projects/180ff6fd8c5b434abffa058ea99ef7c4/users/92d56ad8d4ab4c1099263a3d1c43490a/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:18.093401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.093401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.093401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.093836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:18.116348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] MFA Rules not processed for user `b39d1cd331d846538ee5bd4a8170b5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:18.118427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:18.132611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 801/1615] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:17 2022] PUT /identity/v3/projects/af420d43367c42e4a4b0948706dd0546/users/2d69edafe80649d4aff602b692e294c8/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:18.132611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.140460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.140460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.159880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:18.161132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:18.197857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 815/1616] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:18.198450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.280785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc9566-321d-4941-98d4-6174f5d71dea None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.287322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 802/1617] 10.222.0.55 () {58 vars in 1058 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:18.288938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.333408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.334129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.334453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.334715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.347022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.348417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.356744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0ed02-cfd4-4335-a417-3e9e128492f4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.360308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 816/1618] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:18.361455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.361944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.362645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.362933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.363217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.363909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.365927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e70d9-6cbd-40ee-b060-039f64320540 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.383108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:18.427744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc56-4044-457f-990c-0adc2eb5de0f service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.432004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.432667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.432954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.433234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.443825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:18.446322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.447794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c6609-e757-4435-bd9b-5d83f22ee548 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.459659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 817/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:18.463622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.464024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.464188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.498736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:18.499826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:18.507402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 803/1620] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:18.508636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.509010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.509203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.514727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 818/1621] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:18.514727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.533124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873802c7-4fdd-45c7-971b-13c740f5d04d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.537252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:18.539127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:18.625334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 804/1622] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:18.626398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.640863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98c594-6865-4b03-ba9e-b88a624b62a8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.642790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.645034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.645948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.646527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.651466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.653233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.654090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.654615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.655528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.657870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.747226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.748889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.759766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 819/1623] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:18.760740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.792866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 805/1624] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:18 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:18.792866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.872981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959c13a-f73d-4ca6-adb5-544b4b70a407 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.874884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5798-68e9-4537-8407-03cfaaa67cd1 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.880735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.881418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.881726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.882597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.883877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.885119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.885119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.885119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.909394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.910925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.916312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.917964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.940680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 806/1625] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:18.941710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:18.951380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 820/1626] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:18.957434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc3866-18a8-4d10-a68f-4195220fffd0 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:18.968306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:18.969144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:18.969537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:18.971018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:18.971018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:18.973312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4ea9-f888-4b9a-99b4-d87950138e77 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:18.989286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 807/1627] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:18.991064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:19.002448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e1fb-022f-412f-8cff-0711d05d1072 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:19.010015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:19.011110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.011425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.012437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] PATH_INFO: `/v3/projects/a96f7bae957c4a44b32c6558de247f31/users/c0774f155538422d98e873fdca0d3b86/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.036856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701058-b45b-49ad-8ae5-d49f4a5173ab None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.037600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701058-b45b-49ad-8ae5-d49f4a5173ab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.038133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f701058-b45b-49ad-8ae5-d49f4a5173ab None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.041339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 808/1628] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 31 21:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:19.051743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.052210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.052503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.062211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96f7bae957c4a44b32c6558de247f31, user_id=c0774f155538422d98e873fdca0d3b86, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:19.068932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d2201-08b0-42aa-81e0-e54e4f4bbfb7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:19.075083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:19.076535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:19.093809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 809/1629] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:19.103862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:19.125383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:19.174070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cb1a3-0246-4084-b909-06a8665f0afd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:19.179640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:19.180730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.180863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.181276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.192480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 821/1630] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:18 2022] PUT /identity/v3/projects/a96f7bae957c4a44b32c6558de247f31/users/c0774f155538422d98e873fdca0d3b86/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:19.194147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218b99-9e24-45a1-988f-5a285e061e30 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.198045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218b99-9e24-45a1-988f-5a285e061e30 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.198045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218b99-9e24-45a1-988f-5a285e061e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.212632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:19.221429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:19.223703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:19.239939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 810/1631] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:19.240963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:19.250837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eb218b99-9e24-45a1-988f-5a285e061e30 None None] MFA Rules not processed for user `d5b358c38b5a44d798f7f53c4b318134`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:19.251724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb218b99-9e24-45a1-988f-5a285e061e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:19.252244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881c93-f208-45c0-a939-a1e0e23cb9b7 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:19.401409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 822/1632] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:19.401615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:19.401615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.401615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.401615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.402007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:19.403915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ec8fe-9fc8-4a63-8ff4-8ba500461e28 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.404531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ec8fe-9fc8-4a63-8ff4-8ba500461e28 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.404668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:19.405140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ec8fe-9fc8-4a63-8ff4-8ba500461e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.418359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 811/1633] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:19.426416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:19.441771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f25ec8fe-9fc8-4a63-8ff4-8ba500461e28 None None] MFA Rules not processed for user `d5b358c38b5a44d798f7f53c4b318134`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:19.442759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3407ae-ac35-4b8e-a5cf-ee307616c628 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:19.444855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f25ec8fe-9fc8-4a63-8ff4-8ba500461e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:19.456147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:19.458429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.459113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.459404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] PATH_INFO: `/v3/projects/a96f7bae957c4a44b32c6558de247f31/users/c0774f155538422d98e873fdca0d3b86/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.464676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96f7bae957c4a44b32c6558de247f31, user_id=c0774f155538422d98e873fdca0d3b86, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:19.470186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 823/1634] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:19.470378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:19.483808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 812/1635] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:19 2022] PUT /identity/v3/projects/a96f7bae957c4a44b32c6558de247f31/users/c0774f155538422d98e873fdca0d3b86/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:19.496437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.497029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.498376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.555809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] MFA Rules not processed for user `c0774f155538422d98e873fdca0d3b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:19.557276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:19.651495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 824/1636] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:19.659998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:19.726392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078fb1-f71f-4965-93d8-e961cdd72f1e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:19.730790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:19.731456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:19.731740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:19.732017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:19.744624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:19.744624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:19.759293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 813/1637] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:19.996412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:20.095361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4168b5b-9cf2-4de2-9934-3668de0bc374 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:20.102143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:20.104767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:20.104767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:20.104767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:20.110196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:20.186308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:20.206533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26f45-c6d7-4217-b37c-f5b36f85799f service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:20.211877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:20.212537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:20.212871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:20.213147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:20.214582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:20.217816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:20.230622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 825/1638] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:20.269530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:20.274412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:20.286217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae26cf6-a8c8-47ea-ad54-30e18ae2ca4c service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:20.291782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:20.293269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:20.295866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:20.296556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:20.296847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:20.297132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:20.305559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 814/1639] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:20.389786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:20.391426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e28ca-fe51-4c45-bf24-2518f624da67 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:20.401597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 826/1640] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:21.117806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394c13-7a10-4daa-b73f-1e5009aa003e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394c13-7a10-4daa-b73f-1e5009aa003e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394c13-7a10-4daa-b73f-1e5009aa003e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 827/1641] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 31 21:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:21.128364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:21.132639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:21.171960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:21.173357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:21.177818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818067-3e2e-4adf-ab1a-f089c621c3f5 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:21.185368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:21.186638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:21.187603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:21.187603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] PATH_INFO: `/v3/users/b39d1cd331d846538ee5bd4a8170b5dc` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:21.190164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39d1cd331d846538ee5bd4a8170b5dc)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:21.190164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:21.190164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: warnings.warn(msg) May 31 21:03:21.190164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: May 31 21:03:21.190961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:21.252878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 828/1642] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:21.268071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:21.281520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61748f-0ed2-4b06-80bd-8859ba7f7a78 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:21.286036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:21.286922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:21.287565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:21.287565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:21.301650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:21.303600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74165-d0db-499d-bd2f-1eb82b811633 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:21.316639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 829/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:21.526994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39d1cd331d846538ee5bd4a8170b5dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:21.557439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39d1cd331d846538ee5bd4a8170b5dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:21.558520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39d1cd331d846538ee5bd4a8170b5dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:21.573737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39d1cd331d846538ee5bd4a8170b5dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:21.575079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39d1cd331d846538ee5bd4a8170b5dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:21.692533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 815/1644] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:21 2022] DELETE /identity/v3/users/b39d1cd331d846538ee5bd4a8170b5dc => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:03:21.697166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98a91-f65a-48be-9de8-652c40a49d61 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:21.697935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98a91-f65a-48be-9de8-652c40a49d61 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:21.698460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98a91-f65a-48be-9de8-652c40a49d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:21.730369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-25b98a91-f65a-48be-9de8-652c40a49d61 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:21.746436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-25b98a91-f65a-48be-9de8-652c40a49d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:21.811975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:21.871193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 830/1645] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:21.928026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:21.930114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:22.102162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e46bc2-93c1-4383-aa59-f0b593577143 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:22.109120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580cb3-ac45-4065-a4e2-426b2b1a009d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:22.109120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580cb3-ac45-4065-a4e2-426b2b1a009d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:22.109120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95580cb3-ac45-4065-a4e2-426b2b1a009d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:22.109995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 831/1646] 10.222.0.55 () {54 vars in 960 bytes} [Tue May 31 21:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 21:03:22.110763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:22.111869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:22.112849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:22.113325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:22.124363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:22.126368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:22.132517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:22.137354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:22.143884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:22.166954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:22.166954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:22.170545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 816/1647] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:22.347456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 832/1648] 10.222.0.55 () {58 vars in 1057 bytes} [Tue May 31 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:22.356964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:22.371043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:22.380591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4e8f-478b-44fa-b2d5-87e757de8f00 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:22.393734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:22.396490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:22.398089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:22.398929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:22.403582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:22.423894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:22.426173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fa56b-d502-4bd3-99fb-979bf38509a5 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:22.441601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 817/1649] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:23.740593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:23.743374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:23.808168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43038978-44c5-4df7-8dcf-d6d7422c0dca None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:23.826737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:23.830349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:23.831714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:23.832717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] PATH_INFO: `/v3/projects/850d5d523656499e85e63dd1a5e72857` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:23.839105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850d5d523656499e85e63dd1a5e72857)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:23.840392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 21:03:23.840392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: warnings.warn(msg) May 31 21:03:23.840392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: May 31 21:03:23.842669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:24.046051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850d5d523656499e85e63dd1a5e72857', 'request_id': 'req-186efc37-2b07-4c1b-8e51-68ccebd5cf23'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:24.134446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850d5d523656499e85e63dd1a5e72857', 'request_id': 'req-186efc37-2b07-4c1b-8e51-68ccebd5cf23'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:24.143271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850d5d523656499e85e63dd1a5e72857', 'request_id': 'req-186efc37-2b07-4c1b-8e51-68ccebd5cf23'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:24.184133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] The token cache is being invalidate because project 850d5d523656499e85e63dd1a5e72857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:24.186064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:24.195481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-186efc37-2b07-4c1b-8e51-68ccebd5cf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:24.200694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 833/1650] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:23 2022] DELETE /identity/v3/projects/850d5d523656499e85e63dd1a5e72857 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:24.213334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:24.213334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:24.213334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:24.275581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:24.281278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:24.390341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 818/1651] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:24.399014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:24.399852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:24.400333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:24.421263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:24.422858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:24.436986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:24.447910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 834/1652] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:24.448877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc969d-ff3c-4edc-be7e-4e186644f406 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:24.454784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:24.455656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:24.460961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:24.460961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:24.460961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:24.460961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:24.460961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:24.486264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:24.497174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015356-7f5f-4799-97f3-957f7bea6da9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:24.497497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 819/1653] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:24.502624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:24.507327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:24.507327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:24.507327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:24.507327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:24.509777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:24.704350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:24.706523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 835/1654] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:24 2022] POST /identity/v3/projects => generated 405 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:24.717003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe4a8-d710-4903-8145-0e4613c7c1c2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:24.939935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:24.940895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:24.941186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:24.941712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:24.942449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:24.945217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:25.039549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 820/1655] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:24 2022] POST /identity/v3/users => generated 303 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:25.043141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:25.080261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc974d-0ec4-4e49-945e-c690eaa4b417 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:25.089510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:25.090815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:25.092318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:25.093123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:25.104551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:25.114171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:25.134494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:25.135251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 836/1656] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:25.153543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebe5c-9e3d-4114-a275-8c8daa54ad24 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:25.162057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:25.162896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:25.163691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:25.166585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:25.166585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:25.171057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590152e-5fa0-4dc6-9ec4-64aecd2b2608 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:25.192570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 821/1657] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:25.197282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:25.214534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1937a5b-3673-4383-a30c-f0a89f8884f3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:25.224829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:25.226766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:25.228279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:25.229213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] PATH_INFO: `/v3/projects/34a19d342cf0435fad920e76525e3c5a/users/6d6572f61f114603bca6eaebcb38d9a8/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:25.233843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:25.252143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a19d342cf0435fad920e76525e3c5a, user_id=6d6572f61f114603bca6eaebcb38d9a8, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:25.257588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:25.343701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 837/1658] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:25 2022] PUT /identity/v3/projects/34a19d342cf0435fad920e76525e3c5a/users/6d6572f61f114603bca6eaebcb38d9a8/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:25.355559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:25.356091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:25.356241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:25.393390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] MFA Rules not processed for user `6d6572f61f114603bca6eaebcb38d9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:25.394803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:25.480169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:25.510838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 822/1659] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:25.515603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:25.654122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9705322-afde-4f19-a8a5-d0f8c75707d1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:25.664573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:25.664573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:25.664573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:25.665506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:25.667209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:25.669978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:25.843006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 838/1660] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:25 2022] POST /identity/v3/projects => generated 405 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:25.844289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:25.863170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81917-5340-4dfd-9183-2ce1ae3a3458 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:26.054605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:26.055159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.055460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.055737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.056472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:26.058503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:26.208464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:26.210234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 823/1661] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:25 2022] POST /identity/v3/users => generated 309 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:26.238890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf65d-5014-432b-bd6f-b0b8b66b3449 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:26.258994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:26.259972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.260414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.260836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.261756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:26.263595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:26.290809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 839/1662] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:03:26.295296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:26.325617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b443e-26d6-424f-b480-b64a7aed46a9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:26.336110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:26.338855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.339619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.340102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] PATH_INFO: `/v3/projects/80605244c06145d88b0e486f7c4a1ae8/users/11039d71917c408bb7514d8467476a95/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.423445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80605244c06145d88b0e486f7c4a1ae8, user_id=11039d71917c408bb7514d8467476a95, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:26.435730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:26.575725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 824/1663] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:26 2022] PUT /identity/v3/projects/80605244c06145d88b0e486f7c4a1ae8/users/11039d71917c408bb7514d8467476a95/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:26.580199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:26.595501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230dec5-b3d3-4a44-aaeb-5fef9c07ca7f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:26.742826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:26.743740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.744089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.744372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.745652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:26.751168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dddd83-1fce-4eb3-a1c9-5c417bfeebc9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:26.777640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 840/1664] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:26.782744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:26.804431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2452e-ac76-4633-ac44-a6ebfaff88d9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:26.815401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:26.816342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.816749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.829809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] PATH_INFO: `/v3/projects/80605244c06145d88b0e486f7c4a1ae8/users/11039d71917c408bb7514d8467476a95/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.840308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80605244c06145d88b0e486f7c4a1ae8, user_id=11039d71917c408bb7514d8467476a95, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:26.847366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:26.897993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 825/1665] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:26 2022] PUT /identity/v3/projects/80605244c06145d88b0e486f7c4a1ae8/users/11039d71917c408bb7514d8467476a95/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:26.915222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:26.915536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:26.915884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:26.980277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] MFA Rules not processed for user `11039d71917c408bb7514d8467476a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:26.983477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:27.069752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:27.135541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 841/1666] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:27.150491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:27.152733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:27.354718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3391-cc22-410c-a2ee-89278dc71d29 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:27.375286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:27.377466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:27.378097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:27.380890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:27.420841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:27.423228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df0705-019d-42ea-8c0d-d4726d6f2163 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:27.451207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 826/1667] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:28.168987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:28.314585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b880-d2e9-4f8a-babf-b65cd9d1fdac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:28.328891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:28.329829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:28.330144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:28.330425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] PATH_INFO: `/v3/users/6d6572f61f114603bca6eaebcb38d9a8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:28.332873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6572f61f114603bca6eaebcb38d9a8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:28.333966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:28.597238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6572f61f114603bca6eaebcb38d9a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:28.644396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6572f61f114603bca6eaebcb38d9a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:28.645225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6572f61f114603bca6eaebcb38d9a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:28.667735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6572f61f114603bca6eaebcb38d9a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:28.668603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6572f61f114603bca6eaebcb38d9a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:28.765939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 842/1668] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:28 2022] DELETE /identity/v3/users/6d6572f61f114603bca6eaebcb38d9a8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:28.771350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:28.773737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:28.774338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:28.868872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:28.871927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:29.008497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:29.081031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 827/1669] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:29.101389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:29.103837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:29.305402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd94ca-9ea4-4218-a558-8b2721b26064 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:29.334015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:29.338305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:29.339001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:29.340602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:29.390822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:29.401142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90005527-ad36-4b70-9fe4-931dd29b31ce service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:29.437110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 843/1670] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:29.895987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:29.899505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:29.931086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047585f-2238-4b6a-87a5-02cae096804a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:29.944546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:29.946202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:29.946896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:29.947531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] PATH_INFO: `/v3/users/f8f62f4151e744018155322bc669d06b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:29.949783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f62f4151e744018155322bc669d06b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:29.952937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:30.278927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f62f4151e744018155322bc669d06b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:30.309820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:30.310735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:30.311144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:30.327907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f62f4151e744018155322bc669d06b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:30.330599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f62f4151e744018155322bc669d06b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:30.335384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:30.350645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f62f4151e744018155322bc669d06b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:30.351974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0450b634-6b36-4a1a-af38-5a5e8489b0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f62f4151e744018155322bc669d06b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:30.395989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:30.400646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:30.480933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 828/1671] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:29 2022] DELETE /identity/v3/users/f8f62f4151e744018155322bc669d06b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:30.486609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:30.486915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:30.487223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:30.511975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:30.538996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:30.657651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 844/1672] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:30.718143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:30.718978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 829/1673] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:30.720208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:30.740302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d965-2899-4b22-ae8f-67004c29ee99 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:30.871807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:30.871807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:30.871807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:30.871807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:30.915508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:30.917017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:30.940781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 845/1674] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:31.214770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:31.216363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:31.322601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:31.354340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14311174-c219-4b8c-871a-4aed932e2267 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:31.354340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:31.354340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:31.354340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:31.355037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:31.421810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:31.423519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:31.434529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 830/1675] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:03:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:03:31.582045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:31.583515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:31.603474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bac66-2640-4995-9495-b982944a0194 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:31.623234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:31.625273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:31.625792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:31.626237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] PATH_INFO: `/v3/projects/34a19d342cf0435fad920e76525e3c5a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:31.635362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a19d342cf0435fad920e76525e3c5a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:31.638902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:31.873993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a19d342cf0435fad920e76525e3c5a', 'request_id': 'req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:31.962197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a19d342cf0435fad920e76525e3c5a', 'request_id': 'req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:31.980161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a19d342cf0435fad920e76525e3c5a', 'request_id': 'req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.039049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] The token cache is being invalidate because project 34a19d342cf0435fad920e76525e3c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:32.039049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.039049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2f968a4a-c5f6-496d-a9a4-0695b2bfbc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.057997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 846/1676] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:31 2022] DELETE /identity/v3/projects/34a19d342cf0435fad920e76525e3c5a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:32.060489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:32.111202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a03f1-9612-4807-a363-8864df306afb service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:32.328002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:32.332971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:32.335410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:32.335942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] PATH_INFO: `/v3/users/11039d71917c408bb7514d8467476a95` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:32.340470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11039d71917c408bb7514d8467476a95)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:32.342868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:32.644952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11039d71917c408bb7514d8467476a95'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.665997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11039d71917c408bb7514d8467476a95'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.667758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11039d71917c408bb7514d8467476a95'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.677447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11039d71917c408bb7514d8467476a95'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.680683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11039d71917c408bb7514d8467476a95'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:32.841926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 831/1677] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:32 2022] DELETE /identity/v3/users/11039d71917c408bb7514d8467476a95 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:33.270102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:33.271041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:33.271510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:33.360512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] MFA Rules not processed for user `92d56ad8d4ab4c1099263a3d1c43490a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:33.361829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:33.429131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:33.651145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 847/1678] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:33.674903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:33.676837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:33.738632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:33.997792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b106e0-b1e9-434a-a2fc-ca38c5e55918 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:34.017869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:34.020571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:34.020571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:34.020571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:34.045345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:34.055216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04fe5f-421e-49a9-aa63-ba6a878e39f8 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:34.078494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 832/1679] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:34.458706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:34.460853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:34.679144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a3cd-160b-4d50-83ec-ea440917884f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:34.691896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:34.694898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:34.695326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:34.696226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] PATH_INFO: `/v3/projects/514e3c731ce34db584cf832e0f95d1fe` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:34.700102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514e3c731ce34db584cf832e0f95d1fe)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:34.704022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:34.877812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e55ea-0d34-45c3-9524-85e08d43229f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:34.878703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e55ea-0d34-45c3-9524-85e08d43229f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:34.879136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e55ea-0d34-45c3-9524-85e08d43229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:34.937918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514e3c731ce34db584cf832e0f95d1fe', 'request_id': 'req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:35.004458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2d7e55ea-0d34-45c3-9524-85e08d43229f None None] MFA Rules not processed for user `bbf377756836405d804d2aaba6e44c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:35.012130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2d7e55ea-0d34-45c3-9524-85e08d43229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.035404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514e3c731ce34db584cf832e0f95d1fe', 'request_id': 'req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:35.044005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514e3c731ce34db584cf832e0f95d1fe', 'request_id': 'req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:35.101227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] The token cache is being invalidate because project 514e3c731ce34db584cf832e0f95d1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:35.103663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:35.106544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:35.112214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 848/1680] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:34 2022] DELETE /identity/v3/projects/514e3c731ce34db584cf832e0f95d1fe => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:03:35.114240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:35.122389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.248848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 833/1681] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:35.251330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-54d0-4ddc-a4b1-d44aedf38571 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:35.252097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-54d0-4ddc-a4b1-d44aedf38571 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:35.252417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644cef-54d0-4ddc-a4b1-d44aedf38571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:35.330802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0a644cef-54d0-4ddc-a4b1-d44aedf38571 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:35.336845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0a644cef-54d0-4ddc-a4b1-d44aedf38571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.351529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:35.377847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab8860-58fc-4a2d-8ad6-c624c6dab580 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:35.388423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:35.391083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:35.391377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:35.391658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] PATH_INFO: `/v3/projects/80605244c06145d88b0e486f7c4a1ae8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:35.395143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80605244c06145d88b0e486f7c4a1ae8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:35.397244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:35.518971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 834/1682] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:35.527683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac91b-db34-4198-8d35-8427effdcfe3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:35.528027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac91b-db34-4198-8d35-8427effdcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:35.529552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac91b-db34-4198-8d35-8427effdcfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:35.585580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1ecac91b-db34-4198-8d35-8427effdcfe3 None None] MFA Rules not processed for user `bbf377756836405d804d2aaba6e44c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:35.588489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1ecac91b-db34-4198-8d35-8427effdcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.611248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 835/1683] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:35.613226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf370-f153-42fa-b5bb-3c4dcab0516f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:35.616670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf370-f153-42fa-b5bb-3c4dcab0516f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:35.618030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf370-f153-42fa-b5bb-3c4dcab0516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:35.683233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-de6cf370-f153-42fa-b5bb-3c4dcab0516f None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:35.686439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-de6cf370-f153-42fa-b5bb-3c4dcab0516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.755961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:35.835397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 836/1684] 10.222.0.40 () {58 vars in 1015 bytes} [Tue May 31 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:35.836957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:35.837376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:35.838225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:35.901533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] MFA Rules not processed for user `2d69edafe80649d4aff602b692e294c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:35.903402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:35.993588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80605244c06145d88b0e486f7c4a1ae8', 'request_id': 'req-bdfe6c0a-e789-4df8-be14-2990316bd9dd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:36.070284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80605244c06145d88b0e486f7c4a1ae8', 'request_id': 'req-bdfe6c0a-e789-4df8-be14-2990316bd9dd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:36.079929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80605244c06145d88b0e486f7c4a1ae8', 'request_id': 'req-bdfe6c0a-e789-4df8-be14-2990316bd9dd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:36.126628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] The token cache is being invalidate because project 80605244c06145d88b0e486f7c4a1ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:36.127400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:36.129669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bdfe6c0a-e789-4df8-be14-2990316bd9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:36.132820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 849/1685] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:35 2022] DELETE /identity/v3/projects/80605244c06145d88b0e486f7c4a1ae8 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:36.137470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.137839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.138355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.217178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 837/1686] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:36.219045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:36.221016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:36.222258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.223973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.423848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f73b49-3679-49c4-a7fa-df9bfe008d9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:36.464141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 850/1687] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:36.466749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:36.469550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.589480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7fa71-7a12-400a-aa08-a601921c8c8f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:36.606387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:36.607407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.607852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.609629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.611054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:36.617338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.633955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:36.637952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:36.638843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.640186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.640941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.644404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097423e9-8453-46e8-a872-6d830412c6ab service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:36.646860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.696042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 851/1688] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:36.698434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.698730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.699126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.811860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:36.812781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.866855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:36.875796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:36.876549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 852/1689] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:36.878283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:36.884896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:36.908715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 838/1690] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:36.910327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:36.923183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2a53-6fa6-4b84-8a02-5e77f1822f25 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:36.933184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4776ab-9b7a-4b1d-aa55-424cd1c60a6e service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:36.937786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:36.939378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.939683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.939956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.945272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:36.946191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:36.946473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:36.946754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:36.948801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:36.948801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:36.949825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67309e23-f5b0-4ab4-95be-4df049bec60c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:36.998937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 839/1691] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:37.019181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:37.026207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:37.026207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:37.072197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:37.074585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:37.089296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 840/1692] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:37.089296 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.122238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da1b61-7464-4916-9f20-2e88f40eb36b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:37.137819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:37.140815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:37.140815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:37.140815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:37.142151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:37.144281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:37.180499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:37.270323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:37.272707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:37.320564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 853/1693] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:37.321553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.376901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f857-2e10-4ae2-840c-26e4b9a00d92 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:37.377314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 841/1694] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:37 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:37.383706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.543323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:37.544367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:37.544825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:37.545320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:37.546398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:37.547162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:37.549674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:37.575693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 854/1695] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:37.577677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.611598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1fc6b-bafa-44b9-9d87-d98b5ea060e8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:37.626574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:37.628151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:37.628678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:37.629107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:37.630419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:37.636090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:37.689165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97444-8a75-481a-9447-6e658348478c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:37.700255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:37.702009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:37.702627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:37.711964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:37.713999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:37.718245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:37.842159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 855/1696] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:37 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:37.847889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.852558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 842/1697] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:37 2022] POST /identity/v3/users => generated 285 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:37.860832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:37.887648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83e13f-b18e-4243-96f8-774276cbd7a5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.010779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:38.056974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.057952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.059941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.060718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.061522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.065205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1409244-2126-4e3a-9ba8-6eef27fed00b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.074628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.081041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.082989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.083475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.086832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.087785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.096699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.108515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 843/1698] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:38.109690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.149782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973e5d-1c1a-46b7-8d3d-02fcebe0424e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.166818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.168852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.169231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.169520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.170392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.177361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.267708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 856/1699] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:37 2022] POST /identity/v3/users => generated 294 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:38.272407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.281156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 844/1700] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:38.295868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.337181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771a8c-f21d-4ad0-8498-35eedbddbe12 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.344971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc369131-edbb-4d57-980f-0cae274bba9d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.360361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.363334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.364024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.365864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.368125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.371808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.376977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.380724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.381332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.381947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] PATH_INFO: `/v3/projects/2a926d0fe1ad46b5b8f3d071378bdaee/users/7cf9d46aac284a59844273f80c0d8f81/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.416336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 857/1701] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:38.431607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.437060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a926d0fe1ad46b5b8f3d071378bdaee, user_id=7cf9d46aac284a59844273f80c0d8f81, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.445134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e865ace-f3d5-4b85-994c-78817372f484 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.463505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4ec6c-c4f1-4885-8bea-5b5e10054206 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.472715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.473699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.474806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.475389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.476660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.479097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.492811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:38.510970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 858/1702] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:38.514591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.558409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 845/1703] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:38 2022] PUT /identity/v3/projects/2a926d0fe1ad46b5b8f3d071378bdaee/users/7cf9d46aac284a59844273f80c0d8f81/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:38.571967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.572404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.572853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.585344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1c68-64ae-4ec9-ac8b-8d33e715d016 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.622333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] MFA Rules not processed for user `7cf9d46aac284a59844273f80c0d8f81`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:38.629219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:38.769234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.770678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.772224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.772717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] PATH_INFO: `/v3/projects/868fcda7cfd04e37b610d841d3f8f149/users/1aee7ce69fdc4a97bc22bab24e0b21ea/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.835074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868fcda7cfd04e37b610d841d3f8f149, user_id=1aee7ce69fdc4a97bc22bab24e0b21ea, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.844461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aecbf1-200e-4153-a868-f14539c95bf4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.920668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 846/1704] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:38.925868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:38.954002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e862-453f-40b1-94b9-7d09f899943c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:38.964454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:38.966338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.966338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.966794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:38.975369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:38.979946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:38.981957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 859/1705] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:38 2022] PUT /identity/v3/projects/868fcda7cfd04e37b610d841d3f8f149/users/1aee7ce69fdc4a97bc22bab24e0b21ea/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:38.993781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:38.994107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:38.994391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:39.144823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 847/1706] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:38 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:39.147777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] MFA Rules not processed for user `1aee7ce69fdc4a97bc22bab24e0b21ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:39.149025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:39.149168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:39.418299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 860/1707] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:39.419433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:39.421938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:39.460017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14da31-aee1-48a6-8702-b253ceeb31a9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:39.472931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:39.473687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:39.475115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:39.475648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] PATH_INFO: `/v3/users/f1b9a99fb432495aa5f4d0402a7858ff` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:39.478255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b9a99fb432495aa5f4d0402a7858ff)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:39.479973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34151e99-38a9-494a-9149-742ff0e32e91 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:39.481208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:39.507024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:39.507739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:39.508029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:39.508368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:39.509018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:39.511031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3659216-8a23-4fb8-a63e-6a19be8402ce admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:39.668391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 848/1708] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:39 2022] POST /identity/v3/users => generated 290 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:39.673773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7d89-cbe5-4f43-995c-f72ffc8a9eee None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:39.675963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7d89-cbe5-4f43-995c-f72ffc8a9eee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:39.676142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7d89-cbe5-4f43-995c-f72ffc8a9eee None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:39.684201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 849/1709] 10.222.0.55 () {54 vars in 912 bytes} [Tue May 31 21:03:39 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:39.685173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7d89-cbe5-4f43-995c-f72ffc8a9eee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:39.705528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:39.718485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7d89-cbe5-4f43-995c-f72ffc8a9eee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:39.735040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:39.735040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:39.735040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:39.735040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:39.736318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:39.741997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:39.763987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b9a99fb432495aa5f4d0402a7858ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:39.845850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b9a99fb432495aa5f4d0402a7858ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:39.850980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b9a99fb432495aa5f4d0402a7858ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:39.859628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:39.905016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b9a99fb432495aa5f4d0402a7858ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:39.912653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-22d6631c-4ae9-4c77-a6c5-cae5df32de93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b9a99fb432495aa5f4d0402a7858ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:39.956418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 850/1710] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:39.957603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:39.962355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:40.026609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 861/1711] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:39 2022] DELETE /identity/v3/users/f1b9a99fb432495aa5f4d0402a7858ff => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:40.028409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86953c0-ec10-45ea-a21c-5e8f4d4ebd11 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.029795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86953c0-ec10-45ea-a21c-5e8f4d4ebd11 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.030384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86953c0-ec10-45ea-a21c-5e8f4d4ebd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.111144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b86953c0-ec10-45ea-a21c-5e8f4d4ebd11 None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:40.113870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b86953c0-ec10-45ea-a21c-5e8f4d4ebd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:40.172650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524b50-b610-4329-8a79-26429813253e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:40.318842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:40.319551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.319993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.320131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.320869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:40.330842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe32edd-4e45-4c16-8a86-7ad4b8232aa3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:40.371954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 862/1712] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:40.373592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.373996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.378476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.383196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 863/1713] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:03:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:40.383196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:40.383566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 851/1714] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:40.383651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:40.391570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.393229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.395181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.455198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97779b-0d31-48ae-aa53-f2d37518b855 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:40.462664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:40.462664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.462664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.471397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.472289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:40.474906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:40.496220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:40.503523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:40.534333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 852/1715] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:40.537414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:40.553948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ddc23-d726-47d9-879f-b49f819f28ef None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:40.561369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:40.562649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.563058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.563538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] PATH_INFO: `/v3/projects/33fa085b08484413b89d24537a54fc8b/users/bc9d7b4aaa8449148bca06d9c17dc9f2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.586525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa085b08484413b89d24537a54fc8b, user_id=bc9d7b4aaa8449148bca06d9c17dc9f2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:40.591340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:40.637529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 864/1716] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:40 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:40.639291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:40.642470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:40.696659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6483-e8b1-4b47-86a5-acbd43e67a38 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:40.712043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:40.714023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:40.729400 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:40.730281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 853/1717] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:40 2022] PUT /identity/v3/projects/33fa085b08484413b89d24537a54fc8b/users/bc9d7b4aaa8449148bca06d9c17dc9f2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:40.731019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:40.736693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:40.777461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:40.786263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:40.825382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 865/1718] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:40.827820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:40.852365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249887c8-9a5d-4cd2-aad5-c4c10f817c3c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.089377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.091028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.091709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.095736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.098043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.102753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfcfb8-6c6d-48ce-b0cf-1da5123c1f3c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:41.119561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2b710-e323-4ce1-a801-d70b656ca450 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.129979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 866/1719] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:41.130898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.131637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.132196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.143220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:41.150895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.153419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.154230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.158447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.160186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.176785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:41.217124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 854/1720] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:41.217315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:41.220242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:41.220524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:41.231088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:41.527177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c29e4-0db6-4f89-a818-30b239d1816e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.555964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.557523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.558014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.560589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.598633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.610507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:41.619938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 855/1721] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:41.621320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:41.622312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 867/1722] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:41.623282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:41.650497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f35a5-5d85-4d7c-a3e1-feaca6aee6ed service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.671609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.671609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.671609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.671609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] PATH_INFO: `/v3/projects/33fa085b08484413b89d24537a54fc8b/users/bc9d7b4aaa8449148bca06d9c17dc9f2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.672246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa085b08484413b89d24537a54fc8b, user_id=bc9d7b4aaa8449148bca06d9c17dc9f2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.679025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:41.679279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99324947-a3c1-4626-8c65-245c4b6042e4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.695227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.695914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.696442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.696888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.697779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.699577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f01fa9-1bd7-497b-b390-cf9505bf3ac2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:41.707559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 856/1723] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:41 2022] PUT /identity/v3/projects/33fa085b08484413b89d24537a54fc8b/users/bc9d7b4aaa8449148bca06d9c17dc9f2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:41.721155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:41.721155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:41.763961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 868/1724] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:41.765772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.771979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.772555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.842603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] MFA Rules not processed for user `bc9d7b4aaa8449148bca06d9c17dc9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:41.844751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:41.953179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a85c5-5827-4a0c-b080-2d52096e7bb6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:41.970459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:41.972249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:41.975280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:41.975280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:41.984950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:41.987402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:42.001207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 857/1725] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:42.003041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:42.064408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:42.106719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf4d5-c87e-4435-bccb-c2afb4fa2281 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:42.112276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 869/1726] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:42.124884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:42.127715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:42.141197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:42.141197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:42.141197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:42.141197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] PATH_INFO: `/v3/projects/f0c9d1578e884ef1be2ccfcc0c651089/users/7a5204edf820462a8f0836e6e9fbcef0/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:42.215815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c9d1578e884ef1be2ccfcc0c651089, user_id=7a5204edf820462a8f0836e6e9fbcef0, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:42.228590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f103d-12b5-4d07-8a2d-e346c37ca2e0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:42.376221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951e97-5dbd-4a9e-8856-631c1d027a44 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:42.398580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 858/1727] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:42 2022] PUT /identity/v3/projects/f0c9d1578e884ef1be2ccfcc0c651089/users/7a5204edf820462a8f0836e6e9fbcef0/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:42.398580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:42.398580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:42.398580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:42.405278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:42.406001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:42.406363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:42.406558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:42.460704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:42.462257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc94ed-0498-4296-b7a4-dfa110fbd919 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:42.490557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] MFA Rules not processed for user `92d56ad8d4ab4c1099263a3d1c43490a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:42.504442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 870/1728] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:42.507226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:42.509524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:42.510400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:42.525048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:42.525288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:42.658570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] MFA Rules not processed for user `7a5204edf820462a8f0836e6e9fbcef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:42.659888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:42.782064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 859/1729] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:42.783360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:42.799437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:42.913238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 871/1730] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:42.914878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:43.049750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66751f51-d8bd-4499-9934-2412bca6e3ae None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:43.056188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7196d-758d-4b92-a525-d55d4d57f45c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:43.078944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:43.079352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:43.080721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.081217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.081692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.081805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.082861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:43.085795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:43.095569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.096158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] PATH_INFO: `/v3/users/f672f992aea84b44b92ed22ba602b21c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.099722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f672f992aea84b44b92ed22ba602b21c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:43.105661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:43.247139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 872/1731] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:42 2022] POST /identity/v3/projects => generated 387 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:43.259887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:43.433121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9814-6a17-4643-afc6-d7d7183ff7b6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:43.452399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:43.453115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.453410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.458033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.458033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:43.458033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:43.534043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f672f992aea84b44b92ed22ba602b21c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:43.592959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 873/1732] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:43 2022] POST /identity/v3/users => generated 300 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:43.597101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:43.603124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f672f992aea84b44b92ed22ba602b21c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:43.603925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f672f992aea84b44b92ed22ba602b21c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:43.624156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f672f992aea84b44b92ed22ba602b21c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:43.628945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6942093-399b-4df3-8b78-08db74b371d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f672f992aea84b44b92ed22ba602b21c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:43.631564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f051-c7be-40ad-92f9-391ccb6d6ec8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:43.656027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:43.656639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.656965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.657213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.658049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:43.659755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:43.716011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 874/1733] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:43.719990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:43.738990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:43.758454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9d67-994e-4b06-b2b0-d1ec8d35cd52 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:43.795393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 860/1734] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:42 2022] DELETE /identity/v3/users/f672f992aea84b44b92ed22ba602b21c => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:43.808706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:43.809533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.810168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.810489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:43.811009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.811137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:43.811616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] PATH_INFO: `/v3/projects/43dbc141f38948b9a4fe101d83eea40f/users/58929775f01d472aa96d58a21b06e5fd/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:43.883584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dbc141f38948b9a4fe101d83eea40f, user_id=58929775f01d472aa96d58a21b06e5fd, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:43.886772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:43.939178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:43.954241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:44.007776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 875/1735] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:43 2022] PUT /identity/v3/projects/43dbc141f38948b9a4fe101d83eea40f/users/58929775f01d472aa96d58a21b06e5fd/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:44.011179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:44.020150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:44.107437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:44.179480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:44.270000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 861/1736] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:44.286381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:44.288066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7e99-5a5a-4352-83f9-2363f4c56fc7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:44.314218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:44.320054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:44.320054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:44.320054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] PATH_INFO: `/v3/projects/979727d273dc44faa7861e084aea2022` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:44.320483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc80c0-2115-4abe-ae91-122fb0240286 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:44.325457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979727d273dc44faa7861e084aea2022)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:44.337195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:44.338170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:44.340819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:44.343466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:44.343466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:44.344385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:44.352888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9d02e-26d2-4edd-a729-b580fb7ae53a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:44.405294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 862/1737] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:44.407651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:44.408171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:44.410000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:44.484855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] MFA Rules not processed for user `bbf377756836405d804d2aaba6e44c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:44.489146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:44.653574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 863/1738] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:44.654710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:44.657779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:44.749398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979727d273dc44faa7861e084aea2022', 'request_id': 'req-e475d730-6dcb-4293-8ba9-46356a95d9e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:44.884102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21673c7a-170d-49fd-a58a-97c8491db280 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:44.894723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979727d273dc44faa7861e084aea2022', 'request_id': 'req-e475d730-6dcb-4293-8ba9-46356a95d9e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:44.904417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979727d273dc44faa7861e084aea2022', 'request_id': 'req-e475d730-6dcb-4293-8ba9-46356a95d9e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:44.959207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] The token cache is being invalidate because project 979727d273dc44faa7861e084aea2022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:44.959514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:44.961675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:44.982854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 876/1739] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:44 2022] DELETE /identity/v3/projects/979727d273dc44faa7861e084aea2022 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:44.984104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:44.989675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.012689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:45.099081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:45.104862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.105164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.105473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.112514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.264674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475d730-6dcb-4293-8ba9-46356a95d9e7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:45.285477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:45.286488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.292712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.292712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] PATH_INFO: `/v3/projects/43dbc141f38948b9a4fe101d83eea40f/users/58929775f01d472aa96d58a21b06e5fd/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.294984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dbc141f38948b9a4fe101d83eea40f, user_id=58929775f01d472aa96d58a21b06e5fd, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:45.305367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54749f4-bef1-494a-b8d1-a3b30a751117 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:45.358142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:45.360723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b4d4-11e3-49fa-a40c-a41953f88d2a service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:45.364597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 877/1740] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:44 2022] PUT /identity/v3/projects/43dbc141f38948b9a4fe101d83eea40f/users/58929775f01d472aa96d58a21b06e5fd/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:45.374835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 864/1741] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:45.379850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.380291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8593-8886-4e7b-b759-834c00c4bfc4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.381242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.381765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8593-8886-4e7b-b759-834c00c4bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.382102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8593-8886-4e7b-b759-834c00c4bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.382332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.427652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] MFA Rules not processed for user `58929775f01d472aa96d58a21b06e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:45.431436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.485687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b4c8593-8886-4e7b-b759-834c00c4bfc4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:45.523059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b4c8593-8886-4e7b-b759-834c00c4bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.625431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:45.635815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 865/1742] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:45.655865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:45.663259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.785592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 878/1743] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:45.795214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.795899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.796404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.862252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f647cc-891e-4eca-baec-ebc9558c1571 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:45.879349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:45.881662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:45.883548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:45.886719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:45.888428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:45.899792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:45.938841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:45.942694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 879/1744] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:45.951139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:45.954926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:45.981549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f9e9f-ef26-4cc7-b402-91e866a81dfa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:45.994583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 866/1745] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:45.996251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:45.997767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.001563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.002086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.003738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:46.004189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:46.006631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:46.014347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:46.054935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 880/1746] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:46.060017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:46.083128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b521-a9ac-4415-8928-2757e03b2837 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:46.101633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:46.105563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.108158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.112280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.113864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:46.122499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:46.314063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 867/1747] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:46 2022] POST /identity/v3/projects => generated 401 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:46.318655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:46.334842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941161de-2f08-4a79-a141-9884680b51d3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:46.523053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:46.527704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.528009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.528561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.530497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:46.539644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e339e1-333d-4509-a7af-484bf89aa860 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:46.693717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 881/1748] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:46 2022] POST /identity/v3/users => generated 301 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:46.696031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:46.715487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fa13-0946-424e-9bf6-71991ea6cf8b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:46.774569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cb47-216f-4e05-87c1-566dcabd192f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.775108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cb47-216f-4e05-87c1-566dcabd192f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.775692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2cb47-216f-4e05-87c1-566dcabd192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.778365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:46.779201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.779655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.780015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.780874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:46.788327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:46.863289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 868/1749] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:46.869204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:46.873011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2c2cb47-216f-4e05-87c1-566dcabd192f None None] MFA Rules not processed for user `2d69edafe80649d4aff602b692e294c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:46.873805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2c2cb47-216f-4e05-87c1-566dcabd192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:46.893064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e5b4f-b9c6-4026-a5c8-6a5627af3066 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:46.914866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:46.915847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:46.916395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:46.916909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:46.923225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:46.925084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:46.929218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:46.957695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 869/1750] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:46.959474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:46.989098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f910241-8cab-4aed-a06e-7ec454afcd04 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:47.011397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:47.013074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:47.013642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:47.014171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] PATH_INFO: `/v3/projects/f1c086374cc844d0912118ea22d774af/users/38f0f059360640e2849d51bd40381513/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:47.053538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c086374cc844d0912118ea22d774af, user_id=38f0f059360640e2849d51bd40381513, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:47.058843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:47.103563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 882/1751] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:47.206742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:47.207433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:47.208528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:47.209673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 870/1752] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:46 2022] PUT /identity/v3/projects/f1c086374cc844d0912118ea22d774af/users/38f0f059360640e2849d51bd40381513/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:47.226362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:47.232417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:47.322634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:47.327044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:47.534425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3349-87b1-46fd-bdc8-fe64548d7157 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:47.542057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:47.542888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:47.544563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:47.544906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] PATH_INFO: `/v3/projects/b5cb073f2b5a4019bd4dfac0d0abe4ab` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:47.546948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cb073f2b5a4019bd4dfac0d0abe4ab)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:47.550575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:47.556702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 883/1753] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:47.588555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:47.593534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:47.647662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:47.822957 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cb073f2b5a4019bd4dfac0d0abe4ab', 'request_id': 'req-ace9af9a-d54a-4e9d-97f6-c57270e7115b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:47.842523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0443da4-4f0a-4fe0-9b02-61e45ba818b4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:47.848248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cb073f2b5a4019bd4dfac0d0abe4ab', 'request_id': 'req-ace9af9a-d54a-4e9d-97f6-c57270e7115b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:47.876948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cb073f2b5a4019bd4dfac0d0abe4ab', 'request_id': 'req-ace9af9a-d54a-4e9d-97f6-c57270e7115b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.033534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] The token cache is being invalidate because project b5cb073f2b5a4019bd4dfac0d0abe4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:48.034123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.036867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.039513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 871/1754] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:47 2022] DELETE /identity/v3/projects/b5cb073f2b5a4019bd4dfac0d0abe4ab => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:48.045126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:48.045126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:48.045126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:48.045126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:48.048671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:48.051081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:48.055117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:48.293707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:48.297028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:48.305378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9af9a-d54a-4e9d-97f6-c57270e7115b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:48.321794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:48.328361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 884/1755] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:48.328840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:48.328840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:48.328840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] PATH_INFO: `/v3/users/c0774f155538422d98e873fdca0d3b86` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:48.328840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0774f155538422d98e873fdca0d3b86)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:48.329097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:48.329167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:48.329231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:48.514750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f732f8-82a0-43aa-adb3-20a2563dec7d service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:48.538567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:48.539449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:48.539772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:48.542536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:48.545466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:48.625012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:48.688441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0774f155538422d98e873fdca0d3b86'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.753672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0774f155538422d98e873fdca0d3b86'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.756913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0774f155538422d98e873fdca0d3b86'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.760700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:48.765447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:48.796289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 885/1756] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:48.797231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:48.803149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:48.808405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0774f155538422d98e873fdca0d3b86'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.809338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-59f1fe88-4a09-4f78-a90c-111d1e2b621f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0774f155538422d98e873fdca0d3b86'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:48.855643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639650-50ad-45ca-9957-235cc566b2d7 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:48.875710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:48.876867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:48.877332 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:48.877761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] PATH_INFO: `/v3/users/7cf9d46aac284a59844273f80c0d8f81` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:48.886681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf9d46aac284a59844273f80c0d8f81)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:48.886681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:48.962738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 872/1757] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:48 2022] DELETE /identity/v3/users/c0774f155538422d98e873fdca0d3b86 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:49.255819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf9d46aac284a59844273f80c0d8f81'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:49.274542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf9d46aac284a59844273f80c0d8f81'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:49.275938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf9d46aac284a59844273f80c0d8f81'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:49.288631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf9d46aac284a59844273f80c0d8f81'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:49.290175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf9d46aac284a59844273f80c0d8f81'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:49.458673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 886/1758] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:48 2022] DELETE /identity/v3/users/7cf9d46aac284a59844273f80c0d8f81 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:49.471847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:49.472435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:49.472939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:49.519624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:49.521293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:49.693223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 873/1759] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:49.699397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:49.704682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:49.880172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c76cfb-2c7c-4c61-9cc2-e65576f456d9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:49.888281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:49.889342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:49.889978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:49.890520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:49.905465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:49.907662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:49.920809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 887/1760] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:50.251440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:50.661838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:50.661838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:50.688421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8ceb-acf4-42b9-80a9-665ce4c72ccd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:50.695340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:50.696715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:50.697809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:50.698309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] PATH_INFO: `/v3/projects/a96f7bae957c4a44b32c6558de247f31` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:50.699720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96f7bae957c4a44b32c6558de247f31)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:50.702766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:50.825119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:50.827839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:50.856893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85323fd5-c210-40e9-8f2a-726cf3092bad service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:50.875412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:50.878474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:50.879500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:50.880319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] PATH_INFO: `/v3/projects/2a926d0fe1ad46b5b8f3d071378bdaee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:50.883587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a926d0fe1ad46b5b8f3d071378bdaee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:50.894955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:50.936549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96f7bae957c4a44b32c6558de247f31', 'request_id': 'req-9532148d-5d2a-4435-82dd-5c23f5b570f0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:50.948446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96f7bae957c4a44b32c6558de247f31', 'request_id': 'req-9532148d-5d2a-4435-82dd-5c23f5b570f0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:50.975342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96f7bae957c4a44b32c6558de247f31', 'request_id': 'req-9532148d-5d2a-4435-82dd-5c23f5b570f0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.149093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a926d0fe1ad46b5b8f3d071378bdaee', 'request_id': 'req-05d44292-9593-4f14-bb41-c8ec5655ffc2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.227041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] The token cache is being invalidate because project a96f7bae957c4a44b32c6558de247f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:51.227484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.228285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9532148d-5d2a-4435-82dd-5c23f5b570f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.230220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 874/1761] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:50 2022] DELETE /identity/v3/projects/a96f7bae957c4a44b32c6558de247f31 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:51.232004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbefb6-7b4b-4940-9288-aa0d4a84248a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.232927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbefb6-7b4b-4940-9288-aa0d4a84248a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.233814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbefb6-7b4b-4940-9288-aa0d4a84248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.272147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-59fbefb6-7b4b-4940-9288-aa0d4a84248a None None] MFA Rules not processed for user `38f0f059360640e2849d51bd40381513`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:51.273386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-59fbefb6-7b4b-4940-9288-aa0d4a84248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:51.344371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 875/1762] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:51.345481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.345824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.346070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.361662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a926d0fe1ad46b5b8f3d071378bdaee', 'request_id': 'req-05d44292-9593-4f14-bb41-c8ec5655ffc2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.366647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:51.367914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:51.373072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a926d0fe1ad46b5b8f3d071378bdaee', 'request_id': 'req-05d44292-9593-4f14-bb41-c8ec5655ffc2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.388337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] The token cache is being invalidate because project 2a926d0fe1ad46b5b8f3d071378bdaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:51.388674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.389365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.391583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 888/1763] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:50 2022] DELETE /identity/v3/projects/2a926d0fe1ad46b5b8f3d071378bdaee => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:03:51.392608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:51.394442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:51.462617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 876/1764] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:51.463312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:51.467107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:51.482377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e233a-f67e-4e3f-907b-e89b5774d88a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:51.487044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:51.487961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.488249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.488530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] PATH_INFO: `/v3/users/bc9d7b4aaa8449148bca06d9c17dc9f2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.489779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9d7b4aaa8449148bca06d9c17dc9f2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:51.492313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:51.504293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d44292-9593-4f14-bb41-c8ec5655ffc2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:51.514585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:51.516016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.516719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.517579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.519268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:51.529271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970407c-e010-4a93-8651-107b93cdc590 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:51.739748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 889/1765] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:51 2022] POST /identity/v3/projects => generated 405 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:51.741757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.742420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.743406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.767522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:51.769125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:51.845312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 890/1766] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:51.846994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:51.851219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9d7b4aaa8449148bca06d9c17dc9f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.862277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0c63a-5b7c-4a40-85fa-555f028653ea None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:51.868270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9d7b4aaa8449148bca06d9c17dc9f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.868504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:51.869412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:51.869607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9d7b4aaa8449148bca06d9c17dc9f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.869781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:51.870015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:51.870883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:51.873150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:51.882531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9d7b4aaa8449148bca06d9c17dc9f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:51.883398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9d7b4aaa8449148bca06d9c17dc9f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:52.010654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 891/1767] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:51 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:52.012006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.013799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 877/1768] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:03:51 2022] DELETE /identity/v3/users/bc9d7b4aaa8449148bca06d9c17dc9f2 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:52.022397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:52.023120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.023120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:52.028179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9b0b-6b36-4e9d-b51b-6e5d3b371a03 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.088250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07671-2f78-4210-9e41-d840ed8d7af2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.093725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.094546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.094841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.096289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.096289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.098044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.105674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.106959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.107265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.107692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.108447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:52.108756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.111106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.114607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 878/1769] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:52.116343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.125966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 892/1770] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:03:52.128168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7dd8-af18-46bb-bf68-4237f64314eb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.129978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.135662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.137054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.137555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.138566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] PATH_INFO: `/v3/projects/b5004cba174a446f844c30b2c6f06493/users/7a8de2d92af24eca98b144ac65d85601/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.153557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067016-f3ba-46cc-b451-ca9f8a391403 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.158831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.159520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.159744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5004cba174a446f844c30b2c6f06493, user_id=7a8de2d92af24eca98b144ac65d85601, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.159858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.160108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.160810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.164040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.168172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.385657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:52.387798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 879/1771] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:52 2022] PUT /identity/v3/projects/b5004cba174a446f844c30b2c6f06493/users/7a8de2d92af24eca98b144ac65d85601/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:52.391507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.393972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 893/1772] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:52 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:52.403656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.495193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74403a9b-6be4-402f-b7b9-36e1e13d7ae8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.501136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.502008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.502372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.502725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.503055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb30d50-6da4-4d62-8ca4-3a44bc452ce0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.503832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.507248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.509931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.510633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.510917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.511197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.511943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.513549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.526871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 880/1773] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:03:52.531485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.542497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df40a9-93e4-45be-824a-191597d7e1ff admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.549537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.549537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.549537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.549537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] PATH_INFO: `/v3/projects/b5004cba174a446f844c30b2c6f06493/users/7a8de2d92af24eca98b144ac65d85601/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.551302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5004cba174a446f844c30b2c6f06493, user_id=7a8de2d92af24eca98b144ac65d85601, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.554060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.567130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 881/1774] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:52 2022] PUT /identity/v3/projects/b5004cba174a446f844c30b2c6f06493/users/7a8de2d92af24eca98b144ac65d85601/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:03:52.664020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.665776 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:52.666375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 894/1775] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:52 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:52.670418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.682503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa33c02-1a23-4f57-a145-76da23ddf806 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.748801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.749983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.750699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.751212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.752211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.754445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.760214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd423-b6b9-4048-85aa-61c310e02c66 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.766271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 895/1776] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:52.767244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.768156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.768452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.768684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] PATH_INFO: `/v3/projects/33fa085b08484413b89d24537a54fc8b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.770101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa085b08484413b89d24537a54fc8b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.770969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.773031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.784456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69269-e801-4ae3-85cd-2d546a5d6da1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.797083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.798392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.799047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.799684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.801303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.805380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:52.824756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 896/1777] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:52.831673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:52.848576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c30e9-2a78-431c-b60b-8e4814da96b0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:52.857038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:52.858505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:52.859300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:52.859436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] PATH_INFO: `/v3/projects/49bb09cf8e2549598059e38d7f750e1d/users/6946274d716746c585893716015ca187/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:52.889457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bb09cf8e2549598059e38d7f750e1d, user_id=6946274d716746c585893716015ca187, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:52.895533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c687c-cb12-427a-b9ab-45c944eef1c6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:53.208930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 897/1778] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:52 2022] PUT /identity/v3/projects/49bb09cf8e2549598059e38d7f750e1d/users/6946274d716746c585893716015ca187/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:03:53.221262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.221495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.221977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.226395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa085b08484413b89d24537a54fc8b', 'request_id': 'req-9e91f04c-e73c-41db-8acc-e6ec994fdb34'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:53.233929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa085b08484413b89d24537a54fc8b', 'request_id': 'req-9e91f04c-e73c-41db-8acc-e6ec994fdb34'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:53.246429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa085b08484413b89d24537a54fc8b', 'request_id': 'req-9e91f04c-e73c-41db-8acc-e6ec994fdb34'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:53.282780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] MFA Rules not processed for user `6946274d716746c585893716015ca187`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:53.284039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:53.364365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 898/1779] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:53.366510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:53.403681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] The token cache is being invalidate because project 33fa085b08484413b89d24537a54fc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:03:53.404578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:53.406340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9e91f04c-e73c-41db-8acc-e6ec994fdb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:03:53.408378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 882/1780] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:03:52 2022] DELETE /identity/v3/projects/33fa085b08484413b89d24537a54fc8b => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:53.413758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee33-25da-4510-926a-c0aa661d0cb1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.414510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee33-25da-4510-926a-c0aa661d0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.414975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee33-25da-4510-926a-c0aa661d0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.434984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e5deee33-25da-4510-926a-c0aa661d0cb1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:53.436427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e5deee33-25da-4510-926a-c0aa661d0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:53.466140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27103049-3ef4-4c03-8cf2-ec8f75678689 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:53.468155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:53.468890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.469180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.469561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.470501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:53.473177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:53.529159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 883/1781] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:53.536892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.537456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.537738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.556052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:53.557260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:53.566448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 884/1782] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:53.571068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:53.580696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8883b88-629b-4f8e-a319-dfd03cbcbf9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:53.586481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:53.587161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.587505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.587772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.588546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:03:53.588853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:53.590638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:53.604546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 885/1783] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:03:53.609185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:53.619619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589e5e-8ffc-4768-ba60-5f91dd117820 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:53.624211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:53.624876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.625156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.625431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.626190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:53.628118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:53.680619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 899/1784] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/projects => generated 363 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:53.681531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:53.683323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:53.751527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381645d5-9fa4-4611-8436-fa89532a67dc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:53.756895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:53.757598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:53.757887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:53.758187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:53.758933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:53.760880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:53.994866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:54.002741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 900/1785] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:54.004744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.010853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 886/1786] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:03:53 2022] POST /identity/v3/projects => generated 385 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:03:54.014143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.022847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92113f-d028-43a0-ab6e-0de09ce2a10a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.089795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.090520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.091008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.091296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.092044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.093662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.097086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90480-15d2-4eae-a21e-afc10393f509 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.102774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.103677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.103970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.104235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.104935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.106913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.107984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 901/1787] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:54.108955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.121706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3203-beba-4fff-a79f-043317726ccd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.136265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.136775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.137067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.137347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] PATH_INFO: `/v3/projects/07256998fd0b4c06b531909a17aea95c/users/34849ac0bf74459998c55175752763a0/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.172172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07256998fd0b4c06b531909a17aea95c, user_id=34849ac0bf74459998c55175752763a0, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.174992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.432464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 902/1788] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:54 2022] PUT /identity/v3/projects/07256998fd0b4c06b531909a17aea95c/users/34849ac0bf74459998c55175752763a0/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:54.434078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.459592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 887/1789] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:03:54 2022] POST /identity/v3/users => generated 293 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:03:54.467429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.498200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50bbc3-c110-4981-8203-3cd6c4277bc4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.585049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd7e61-e85b-4996-925d-bfe14cc0945b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.590119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.590928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.591240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.591522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.592290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.593954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.600480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.607641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.607641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.607641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.607641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.607641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.612638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 903/1790] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:03:54.613671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.616824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 888/1791] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:54.620881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.632271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4c59-b8cf-4cc6-95ee-e3e3e637b841 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.640594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db39a8b-9b82-48d7-a2a3-a1d835fbd33f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.645259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.646338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.647168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.647583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] PATH_INFO: `/v3/projects/07256998fd0b4c06b531909a17aea95c/users/34849ac0bf74459998c55175752763a0/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.649868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07256998fd0b4c06b531909a17aea95c, user_id=34849ac0bf74459998c55175752763a0, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.651382 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.652222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.652510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.652610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.652789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.653621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.655280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36443d9f-e29b-4a77-8c64-cadc2a3772db admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.665102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 904/1792] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:54 2022] PUT /identity/v3/projects/07256998fd0b4c06b531909a17aea95c/users/34849ac0bf74459998c55175752763a0/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:54.669944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 889/1793] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:03:54.671812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.675181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.675483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.675768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.715623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] MFA Rules not processed for user `34849ac0bf74459998c55175752763a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:54.715623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:54.750521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62beda-9074-4436-a803-87108759ee53 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.758179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.765490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.765490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.765490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] PATH_INFO: `/v3/projects/d621a30b54b647b6a40bba1e0644496d/users/d94984ac499948febff11233b01f6a97/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.776573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d621a30b54b647b6a40bba1e0644496d, user_id=d94984ac499948febff11233b01f6a97, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.779343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.805699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 890/1794] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:54.817491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:54.818945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:54.909197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62071b49-1a9c-4e1e-80af-4e889c7a5a7b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:54.917009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:54.918573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.918876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.919155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:54.931868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:54.934517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6531bb9-083f-4e74-a027-811bc8466213 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:54.951855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 891/1795] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:54.983265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 905/1796] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:03:54 2022] PUT /identity/v3/projects/d621a30b54b647b6a40bba1e0644496d/users/d94984ac499948febff11233b01f6a97/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:03:54.994961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:54.995638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:54.996645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:55.034077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] MFA Rules not processed for user `d94984ac499948febff11233b01f6a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:55.035756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:55.188787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 892/1797] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:55.196756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:55.198627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:55.317018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53fe2-efe0-4d42-bf74-e4d1eea66916 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:55.329496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:55.330470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:55.331648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:55.333412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:55.356170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:55.361411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a33cb-37ca-413b-89e7-900521ee047e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:55.385867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 906/1798] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:55.502560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:55.519383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13404-4d6c-4b14-a04e-87fd13c39216 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:55.528574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:55.529257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:55.529614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:55.529934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:55.533563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:55.613729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:55.617031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:55.648960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 893/1799] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:56.179630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ee59-2332-4f08-b197-523815e8e3a1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:56.179975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ee59-2332-4f08-b197-523815e8e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:56.180182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ee59-2332-4f08-b197-523815e8e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:56.236434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fef3ee59-2332-4f08-b197-523815e8e3a1 None None] MFA Rules not processed for user `7a8de2d92af24eca98b144ac65d85601`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:56.238589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fef3ee59-2332-4f08-b197-523815e8e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:56.455861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 907/1800] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:57.269324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:57.279470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc49f-4893-4bd5-9797-c503b862713a service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:57.283940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:57.284702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:57.284989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:57.285267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:57.287791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:57.319890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:57.377217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:57.379710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f186aca-a396-46f0-9e35-7432984cbe9e service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:57.403434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 894/1801] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:03:57.942394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:03:58.112817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:58.113463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:58.114769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:58.117817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 908/1802] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:03:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 21:03:58.149846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2af7-bcf3-4765-b4c3-d728d4b5a139 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:58.150502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2af7-bcf3-4765-b4c3-d728d4b5a139 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:58.151008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e2af7-bcf3-4765-b4c3-d728d4b5a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:58.188313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bf9e2af7-bcf3-4765-b4c3-d728d4b5a139 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:58.189550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf9e2af7-bcf3-4765-b4c3-d728d4b5a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:58.361743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 895/1803] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:03:58.398742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:58.400699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:58.430349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24960f-d658-45c5-ba01-1635fb38becb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:58.436775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:58.437641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:58.438213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:58.438599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:58.450128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:58.452172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7e4e9-e160-4d1a-bff6-1784442eb428 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:58.470495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 909/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:03:59.289887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:59.290600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:59.291457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:59.294925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 896/1805] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:03:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:03:59.337180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5917c-a453-48e6-889a-8b9e26c07a48 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:59.337473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5917c-a453-48e6-889a-8b9e26c07a48 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:59.337769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5917c-a453-48e6-889a-8b9e26c07a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:59.362526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5df5917c-a453-48e6-889a-8b9e26c07a48 None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:03:59.364072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5df5917c-a453-48e6-889a-8b9e26c07a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:59.447115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 910/1806] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:03:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:03:59.521149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:03:59.524424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:03:59.555687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a82d84-c3d8-4131-a5cd-6a9a9a15e15f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:03:59.562700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:03:59.563651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:03:59.564133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:03:59.564479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:03:59.576717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:03:59.579097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37349a-af27-4f00-a039-ff345d34930f service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:03:59.590629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 897/1807] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:03:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:00.098866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:00.100442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:00.100967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:00.110746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 911/1808] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:04:00.151546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:00.151546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:00.151905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:00.226956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:00.229717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:00.281702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 898/1809] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:00.296203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:00.320608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:00.322848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:00.345396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8145b-f9aa-456c-921b-93a0c447c91e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:00.351519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:00.352176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:00.352458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:00.352736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:00.361936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:00.363555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:00.376380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 912/1810] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:01.168395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:01.170155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:01.246328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb4cd3-c001-4105-b317-ee3f2982945f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:01.251378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:01.252256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:01.252541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:01.252820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] PATH_INFO: `/v3/users/38f0f059360640e2849d51bd40381513` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:01.254101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f0f059360640e2849d51bd40381513)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:01.256080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:01.260986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:01.556247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f0f059360640e2849d51bd40381513'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:01.580790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f0f059360640e2849d51bd40381513'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:01.583132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f0f059360640e2849d51bd40381513'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:01.596858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f0f059360640e2849d51bd40381513'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:01.597805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f0f059360640e2849d51bd40381513'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:01.687774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 899/1811] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:01 2022] DELETE /identity/v3/users/38f0f059360640e2849d51bd40381513 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:01.995351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:02.011170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcdd30-ee9c-4f0b-b7cb-6db8a093a574 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:02.093752 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:02.094770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:02.095052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:02.095331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] PATH_INFO: `/v3/projects/f1c086374cc844d0912118ea22d774af` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:02.096616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c086374cc844d0912118ea22d774af)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:02.099040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:02.254669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c086374cc844d0912118ea22d774af', 'request_id': 'req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.358252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c086374cc844d0912118ea22d774af', 'request_id': 'req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.364533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c086374cc844d0912118ea22d774af', 'request_id': 'req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.375441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] The token cache is being invalidate because project f1c086374cc844d0912118ea22d774af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:02.375727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.376385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.377991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 913/1812] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:01 2022] DELETE /identity/v3/projects/f1c086374cc844d0912118ea22d774af => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:02.382674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:02.384195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:02.398914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcdf23-f4f2-4158-96f8-1bd06ca67aa7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:02.439330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:02.467429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:02.468362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:02.468650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:02.468925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] PATH_INFO: `/v3/users/7a8de2d92af24eca98b144ac65d85601` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:02.470300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8de2d92af24eca98b144ac65d85601)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:02.472310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:02.677061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8de2d92af24eca98b144ac65d85601'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.689479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8de2d92af24eca98b144ac65d85601'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.690249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8de2d92af24eca98b144ac65d85601'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.697623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8de2d92af24eca98b144ac65d85601'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.698905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4d52c794-0f4b-46ff-a36e-e794882fbede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8de2d92af24eca98b144ac65d85601'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:02.779434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 900/1813] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:02 2022] DELETE /identity/v3/users/7a8de2d92af24eca98b144ac65d85601 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:03.008413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:03.114146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:03.115569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:03.128210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b6b1-4cee-4ca9-a306-c9b0c72d8c5d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:03.203103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:03.204190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.204432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.204705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] PATH_INFO: `/v3/projects/b5004cba174a446f844c30b2c6f06493` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.206026 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5004cba174a446f844c30b2c6f06493)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:03.207933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:03.344739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5004cba174a446f844c30b2c6f06493', 'request_id': 'req-6485c346-b0e4-4f54-b2e1-315da592996f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:03.432556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5004cba174a446f844c30b2c6f06493', 'request_id': 'req-6485c346-b0e4-4f54-b2e1-315da592996f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:03.439146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5004cba174a446f844c30b2c6f06493', 'request_id': 'req-6485c346-b0e4-4f54-b2e1-315da592996f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:03.450504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] The token cache is being invalidate because project b5004cba174a446f844c30b2c6f06493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:03.450789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:03.451446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6485c346-b0e4-4f54-b2e1-315da592996f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:03.453256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 914/1814] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:03 2022] DELETE /identity/v3/projects/b5004cba174a446f844c30b2c6f06493 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:03.458204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.458822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.458822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.479050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:03.480486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:03.542168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 901/1815] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:03.550041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.550339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.550624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.568933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:03.570182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:03.578525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 915/1816] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:03.583369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:03.593431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28cea1-904b-47c5-b3c3-5f86e0f22bfb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:03.598417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:03.599154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.599453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.599726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.602596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:03.602596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:03.602978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:03.616897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 902/1817] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:03.621699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:03.641882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dfefc-d40a-4795-b509-d26c1ca4db45 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:03.647188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:03.647880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.648168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.648499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.649260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:03.651227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:03.722129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:03.773215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 916/1818] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:03 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:03.778558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:03.791254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b63899-6e58-4062-8ef6-d52c52cf1a02 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:03.849536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:03.850758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.851039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.851312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:03.852015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:03.853934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:03.977467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 903/1819] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:03 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:03.983208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:03.993080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e760a-55e0-4ad0-9978-ba2b273ca898 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:03.998601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:03.999302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:03.999586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:03.999882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.000619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.002554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.015321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 917/1820] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:04.019662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.033191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d693b8-57c2-4fd4-beb6-444de09087e5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.038120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.038807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.039121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.039397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.040207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.041856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea556fd-e6fe-42de-9bb0-88320f2ab266 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.053098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 904/1821] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:04.057982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.068169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e043e05-f833-45ed-95c1-9645e4618269 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.073871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.074871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.075154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.075429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] PATH_INFO: `/v3/projects/5653894a4a2146ccbdf1918dbf7f3095/users/f316e513402f4c4aaf6b2440fd2eb84c/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.092267 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5653894a4a2146ccbdf1918dbf7f3095, user_id=f316e513402f4c4aaf6b2440fd2eb84c, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.094983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.164363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 918/1822] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:04 2022] PUT /identity/v3/projects/5653894a4a2146ccbdf1918dbf7f3095/users/f316e513402f4c4aaf6b2440fd2eb84c/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:04.174883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.175176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.175458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.202228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] MFA Rules not processed for user `f316e513402f4c4aaf6b2440fd2eb84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:04.203742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:04.268040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 905/1823] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:04.273459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.332647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b88c-6dc8-41db-a060-9610cabd2311 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.337751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.338496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.338786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.339058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.339741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.341669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.455154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 919/1824] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:04 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:04.456681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.468742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e4070-4bfb-4faf-9553-996b523b29d5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.532453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.533148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.533616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.534030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.534816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.536906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.670489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 906/1825] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:04 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:04.674698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.684916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c329b-501d-497f-b2de-65cdd032170c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.689404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.690101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.690383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.692531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.692531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.692959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.704452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 920/1826] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:04.708600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.719693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd91b3-a30d-410f-8e60-daf9a346db4b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.724299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.725209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.725491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.725765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] PATH_INFO: `/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d/users/422ed8dcd78445598492a671da5a3368/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.742414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81bb1fa65cf4b108f75bc9a7387482d, user_id=422ed8dcd78445598492a671da5a3368, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.745076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.879122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 907/1827] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:04 2022] PUT /identity/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d/users/422ed8dcd78445598492a671da5a3368/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:04.884009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:04.894314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcdd33-8503-48fa-a369-76795439f100 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:04.970333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:04.973389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:04.973389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:04.973389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:04.973389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:04.975894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d1105-4211-498c-a298-b2388c00f6c9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:04.991276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 921/1828] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:04.991357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:05.010910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b347-c510-4753-9440-8a096c0c1fa4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:05.016128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:05.017036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.017319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.017593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] PATH_INFO: `/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d/users/422ed8dcd78445598492a671da5a3368/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.019763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81bb1fa65cf4b108f75bc9a7387482d, user_id=422ed8dcd78445598492a671da5a3368, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:05.022406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:05.032720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 908/1829] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:04 2022] PUT /identity/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d/users/422ed8dcd78445598492a671da5a3368/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:05.044695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.045034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.048175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.073624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] MFA Rules not processed for user `422ed8dcd78445598492a671da5a3368`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:05.074886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:05.148665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 922/1830] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:05.160264 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:05.162265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:05.164504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:05.213618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:05.228451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efa977-80e2-42b5-9996-5559fe3f53fb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:05.232323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:05.232983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.233266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.233541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.245579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:05.247151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:05.258343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 909/1831] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:05.470062 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:05.480891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936433f-81cd-4f61-b3c6-3913f64201ba None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:05.484503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:05.485155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:05.485429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:05.485700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:05.547509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:05.549677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:05.561721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 923/1832] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:08.147669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:08.181413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:08.472873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:09.872658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:10.239150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:11.918301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:11.919755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.026462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:12.027925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.073586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb397-7fa7-48d1-8691-1077721a0805 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:12.080426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:12.082036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.082467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.082911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] PATH_INFO: `/v3/users/d94984ac499948febff11233b01f6a97` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.085777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94984ac499948febff11233b01f6a97)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:12.090006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:12.157734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbd5c-9d0c-48ef-8626-914825beaa23 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:12.163847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:12.164841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.165384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.165720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] PATH_INFO: `/v3/users/1aee7ce69fdc4a97bc22bab24e0b21ea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.167195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aee7ce69fdc4a97bc22bab24e0b21ea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:12.169944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:12.385620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94984ac499948febff11233b01f6a97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.401418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94984ac499948febff11233b01f6a97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.402414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94984ac499948febff11233b01f6a97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.410062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94984ac499948febff11233b01f6a97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.410806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d96b8bd7-8d9b-4596-b383-131de5e81fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94984ac499948febff11233b01f6a97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.524989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aee7ce69fdc4a97bc22bab24e0b21ea'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.537079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aee7ce69fdc4a97bc22bab24e0b21ea'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.538404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aee7ce69fdc4a97bc22bab24e0b21ea'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.546421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 910/1833] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:11 2022] DELETE /identity/v3/users/d94984ac499948febff11233b01f6a97 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:12.551247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.551723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.551831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aee7ce69fdc4a97bc22bab24e0b21ea'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.552404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.552508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0442651f-7017-4d41-8032-ee59c402b405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aee7ce69fdc4a97bc22bab24e0b21ea'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:12.575591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:12.576876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.602708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:12.635972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 924/1834] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:12 2022] DELETE /identity/v3/users/1aee7ce69fdc4a97bc22bab24e0b21ea => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:12.640402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.640866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.641156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.660035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 911/1835] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:12.664276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:12.665544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.672184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:12.675501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.732745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 925/1836] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:12.742495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:12.744781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:12.762991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca95c-89f5-4a19-b3ca-3883f50494c9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:12.825344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803c6c2-62ac-4a71-9244-ff2163cd82e3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:12.826768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:12.827746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.827979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.828669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.831061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:12.832163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:12.832544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:12.832921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:12.840009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:12.841459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:12.844620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:12.846471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:12.853356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 912/1837] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:12.865970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 926/1838] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:04:13.345367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:13.399626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:13.414004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:13.416067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:13.433412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d23219-02b8-4712-8c47-9d007ea2cb10 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:13.439640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:13.440547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.440774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.441046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] PATH_INFO: `/v3/projects/d621a30b54b647b6a40bba1e0644496d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.442786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d621a30b54b647b6a40bba1e0644496d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:13.444992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:13.466216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:13.467674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:13.484601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd6d3-6fe3-4968-b32e-4ca305eb5d76 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:13.490170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:13.491605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.492047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.492491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] PATH_INFO: `/v3/projects/868fcda7cfd04e37b610d841d3f8f149` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.494155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868fcda7cfd04e37b610d841d3f8f149)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:13.496444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:13.568621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd621a30b54b647b6a40bba1e0644496d', 'request_id': 'req-a75e0803-9c2c-4034-b941-67b22ec4d4a8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.578834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd621a30b54b647b6a40bba1e0644496d', 'request_id': 'req-a75e0803-9c2c-4034-b941-67b22ec4d4a8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.587470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd621a30b54b647b6a40bba1e0644496d', 'request_id': 'req-a75e0803-9c2c-4034-b941-67b22ec4d4a8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.653927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868fcda7cfd04e37b610d841d3f8f149', 'request_id': 'req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.663949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] The token cache is being invalidate because project d621a30b54b647b6a40bba1e0644496d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:13.664410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.665483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a75e0803-9c2c-4034-b941-67b22ec4d4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.668804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 913/1839] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:13 2022] DELETE /identity/v3/projects/d621a30b54b647b6a40bba1e0644496d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:13.674108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e066-1f49-4de9-ba9a-1f4c55f83134 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.675072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e066-1f49-4de9-ba9a-1f4c55f83134 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.680748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e066-1f49-4de9-ba9a-1f4c55f83134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.703730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-df89e066-1f49-4de9-ba9a-1f4c55f83134 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:13.704920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-df89e066-1f49-4de9-ba9a-1f4c55f83134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:13.754586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868fcda7cfd04e37b610d841d3f8f149', 'request_id': 'req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.763544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868fcda7cfd04e37b610d841d3f8f149', 'request_id': 'req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.790272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] The token cache is being invalidate because project 868fcda7cfd04e37b610d841d3f8f149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:13.790800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.791783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:13.794558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 927/1840] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:13 2022] DELETE /identity/v3/projects/868fcda7cfd04e37b610d841d3f8f149 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:13.799080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:13.801531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:13.823644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 914/1841] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:13.836748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.837632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.837987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.858708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:13.859945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:13.872713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 915/1842] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:13.878562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:13.889306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c593b-7e24-4b52-89b4-98ebe4ac5d12 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:13.891177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721277d-e2db-4529-8af0-ddbe9b578d5b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:13.894234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:13.895148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.895435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.895747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] PATH_INFO: `/v3/users/7a5204edf820462a8f0836e6e9fbcef0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.897942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5204edf820462a8f0836e6e9fbcef0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:13.898339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:13.899478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.899739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:13.899981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.900412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.901298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:13.901633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:13.903891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:13.923425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 916/1843] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:13.928026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:13.939566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f474c04-a5f7-472d-a101-3e6ba81546a3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:13.945461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:13.946181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:13.946464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:13.946740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:13.947455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:13.949486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.085593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 917/1844] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:13 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:14.090669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.148007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5204edf820462a8f0836e6e9fbcef0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:14.166106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1855b-39a3-4bc3-82f0-0cf0e997247b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.166378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5204edf820462a8f0836e6e9fbcef0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:14.167032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5204edf820462a8f0836e6e9fbcef0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:14.172077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.172983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.173310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.174297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.175024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5204edf820462a8f0836e6e9fbcef0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:14.175779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5204edf820462a8f0836e6e9fbcef0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:14.175977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.182151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.271854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 928/1845] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:13 2022] DELETE /identity/v3/users/7a5204edf820462a8f0836e6e9fbcef0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:14.285145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 918/1846] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:14 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:14.292029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.294378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:14.397861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf426-6584-4d15-829a-d4bb6c31d387 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.405710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.406816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.406816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.407262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.408133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.410120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.421719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 929/1847] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:14.427169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.437839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f743-c30f-48c1-a479-6c5590b8dc64 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.442727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.443425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.443718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.443997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.445284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.446961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b0fad-c3f5-4af4-af81-6b65708543ba admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.469071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 919/1848] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:14.473523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.484735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c648-0ed3-466d-b2f3-2f4cea508705 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.490067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.491036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.491352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.491605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] PATH_INFO: `/v3/projects/e99ab3a635584abbad643411c3567295/users/c17da591bb5b4170a962fc8b518bbfb7/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.512241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99ab3a635584abbad643411c3567295, user_id=c17da591bb5b4170a962fc8b518bbfb7, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.518224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.598248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 930/1849] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:14 2022] PUT /identity/v3/projects/e99ab3a635584abbad643411c3567295/users/c17da591bb5b4170a962fc8b518bbfb7/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:14.609815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.610308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.610663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.645357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] MFA Rules not processed for user `c17da591bb5b4170a962fc8b518bbfb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:14.647840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:14.749537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 920/1850] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:14.766523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.769740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:14.821274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:14.829054 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:14.831404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:14.867792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45366-e613-42ba-8517-e86fdec5a31e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.874732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.876260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.876471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.876693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.903697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.905732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:14.921306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 931/1851] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:14.959936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907e44-c210-4c55-bf20-b1912d6663e5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:14.983891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:14.989506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:14.989506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:14.989506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] PATH_INFO: `/v3/projects/f0c9d1578e884ef1be2ccfcc0c651089` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:14.989506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c9d1578e884ef1be2ccfcc0c651089)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:14.999642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:15.275355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c9d1578e884ef1be2ccfcc0c651089', 'request_id': 'req-70fdc21c-a9b5-4c73-9507-bc1986b68200'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.284128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c9d1578e884ef1be2ccfcc0c651089', 'request_id': 'req-70fdc21c-a9b5-4c73-9507-bc1986b68200'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.291695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c9d1578e884ef1be2ccfcc0c651089', 'request_id': 'req-70fdc21c-a9b5-4c73-9507-bc1986b68200'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.386307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] The token cache is being invalidate because project f0c9d1578e884ef1be2ccfcc0c651089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:15.386653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.387450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.389252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 921/1852] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:14 2022] DELETE /identity/v3/projects/f0c9d1578e884ef1be2ccfcc0c651089 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:15.393783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:15.409636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb532-80b6-4095-9bfd-7ed895c93582 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:15.489130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:15.490139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:15.490483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:15.490852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] PATH_INFO: `/v3/users/58929775f01d472aa96d58a21b06e5fd` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:15.493362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58929775f01d472aa96d58a21b06e5fd)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:15.495608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:15.685536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58929775f01d472aa96d58a21b06e5fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.707168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58929775f01d472aa96d58a21b06e5fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.707946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58929775f01d472aa96d58a21b06e5fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.716508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58929775f01d472aa96d58a21b06e5fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.717357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dbc67d0c-f514-4464-89d7-c30fe8e72cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58929775f01d472aa96d58a21b06e5fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:15.751475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:15.835548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 932/1853] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:15 2022] DELETE /identity/v3/users/58929775f01d472aa96d58a21b06e5fd => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:16.413980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:16.416427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:16.451381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc21c-a9b5-4c73-9507-bc1986b68200 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:16.522196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:16.523839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:16.524218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:16.524594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] PATH_INFO: `/v3/projects/43dbc141f38948b9a4fe101d83eea40f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:16.526000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dbc141f38948b9a4fe101d83eea40f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:16.528069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:16.656734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dbc141f38948b9a4fe101d83eea40f', 'request_id': 'req-6d543fde-d87d-450e-ac12-285dd5a80907'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:16.665687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dbc141f38948b9a4fe101d83eea40f', 'request_id': 'req-6d543fde-d87d-450e-ac12-285dd5a80907'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:16.672389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dbc141f38948b9a4fe101d83eea40f', 'request_id': 'req-6d543fde-d87d-450e-ac12-285dd5a80907'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:16.773537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] The token cache is being invalidate because project 43dbc141f38948b9a4fe101d83eea40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:16.773827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:16.774506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6d543fde-d87d-450e-ac12-285dd5a80907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:16.776165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 922/1854] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:16 2022] DELETE /identity/v3/projects/43dbc141f38948b9a4fe101d83eea40f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:16.782175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:16.788781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:16.788781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:16.810887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:16.812179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:16.871676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 933/1855] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:16.881235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:16.886032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:16.886032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:16.901838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:16.903105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:16.911202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 923/1856] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:16.916942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:16.927111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6065-0501-427f-9dc4-b41b7ee28f26 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:16.932131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:16.932802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:16.933084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:16.933358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:16.934188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:16.934496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:16.936131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:16.949585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 934/1857] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:16.952749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:16.954376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:16.964632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21c19c-3211-4dbf-b391-224f234c5b7f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:16.969708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:16.970417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:16.970702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:16.970992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:16.971699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:16.973596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.069276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 924/1858] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:16 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:17.073536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.083771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019942-237a-4f74-b69b-f22f2997d04a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.139862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.140540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.140827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.141110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.141995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.143939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.253944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 935/1859] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:17 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:17.258707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.270406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2fbe-3daa-41d2-a5c4-c60d3406b192 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.276065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.276746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.277072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.277351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.278198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.279829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.290531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 925/1860] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:17.295388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.306257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff1be-385d-4b21-8152-2e7eaadc92a5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.311077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.311824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.312116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.312399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.313279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.314992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf5c5-f28c-4586-9110-b4b483690869 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.326366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 936/1861] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:17.332219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.342988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3390b8-2524-4482-a596-5229f480a8d6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.347711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.348611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.348892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.349165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] PATH_INFO: `/v3/projects/ca48e1ded936448a99ff47ef56d4f036/users/bed186587f3844cd972a7b7b0a870a76/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.365289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca48e1ded936448a99ff47ef56d4f036, user_id=bed186587f3844cd972a7b7b0a870a76, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.367989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.442134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 926/1862] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:17 2022] PUT /identity/v3/projects/ca48e1ded936448a99ff47ef56d4f036/users/bed186587f3844cd972a7b7b0a870a76/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:17.448093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:17.457092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.457471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.457837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.485041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] MFA Rules not processed for user `bed186587f3844cd972a7b7b0a870a76`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:17.486296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:17.553268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 937/1863] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:17.563336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.641642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b43b0-7b97-4af8-bc49-206a68e02cb7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.646878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.647627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.647914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.648399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.649460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.651613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.694508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:17.762867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 927/1864] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:17 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:17.766871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:17.778673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316a36a-adbd-4f34-a312-26d23c0944ac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:17.880787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:17.881474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:17.882513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:17.882799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:17.883520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:17.885454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:17.999877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 938/1865] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:17 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:18.004204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.016008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5b54e-31d0-4eba-ab9f-9772b215985b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.021251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.022006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.022328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.022669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.023809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.025426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.038499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 928/1866] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:18.042677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.056289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb78ab-a545-48fe-95ae-bbcc06cf56ef admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.063069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.064355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.064855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.065149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] PATH_INFO: `/v3/projects/72e520f239394a43a7a41d83ec271691/users/00a210a21f64406091d11c59883dd1a8/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.083352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e520f239394a43a7a41d83ec271691, user_id=00a210a21f64406091d11c59883dd1a8, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.086542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.197654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 939/1867] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:18 2022] PUT /identity/v3/projects/72e520f239394a43a7a41d83ec271691/users/00a210a21f64406091d11c59883dd1a8/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:18.202044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.212912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d344eb-fcba-48bb-bfde-1c474e097937 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.279748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.280452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.280741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.281021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.281826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.283700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcacba-4e87-43f2-86cc-6965b79c8c42 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.295652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 929/1868] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:18.299838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.311242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa037-4ff8-4aab-95e2-760b0d4bcad3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.315987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.316965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.317154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.317431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] PATH_INFO: `/v3/projects/72e520f239394a43a7a41d83ec271691/users/00a210a21f64406091d11c59883dd1a8/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.319457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e520f239394a43a7a41d83ec271691, user_id=00a210a21f64406091d11c59883dd1a8, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.322172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.333756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 940/1869] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:18 2022] PUT /identity/v3/projects/72e520f239394a43a7a41d83ec271691/users/00a210a21f64406091d11c59883dd1a8/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:18.344140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.346011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.346011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.375032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] MFA Rules not processed for user `00a210a21f64406091d11c59883dd1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:18.376417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:18.450505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 930/1870] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:18.564924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.567226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:18.643664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec757-e432-4f88-a599-5b87fe97885f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.647241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.647900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.648272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.648567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.659150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.660613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.672117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 941/1871] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:18.742364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:18.743893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:18.758553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadaae-55af-4eca-8bae-b3af69c41263 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:18.763988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:18.764804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:18.765204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:18.765804 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:18.843365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:18.845031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78652827-8db4-4c6a-99b9-edf2fd05d088 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:18.856103 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 931/1872] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:18.860059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:19.036663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:20.033160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:20.170455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:27.396301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:27.398399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:27.492245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1cf2a-bfe6-47fd-bd94-d96ee0e4ced8 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:27.497553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:27.498508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:27.498797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:27.499081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] PATH_INFO: `/v3/users/6946274d716746c585893716015ca187` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:27.500420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6946274d716746c585893716015ca187)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:27.502458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:27.728198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6946274d716746c585893716015ca187'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:27.741404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6946274d716746c585893716015ca187'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:27.742214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6946274d716746c585893716015ca187'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:27.750173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6946274d716746c585893716015ca187'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:27.750832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6946274d716746c585893716015ca187'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:27.822423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 942/1873] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:27 2022] DELETE /identity/v3/users/6946274d716746c585893716015ca187 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:27.826960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:27.827409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:27.827520 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:27.833427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:27.846539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:27.847772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:27.914888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 932/1874] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:27.925955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:27.928274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:28.020682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2868-44a1-4def-8184-a8787aa158be admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:28.026795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:28.027482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:28.027768 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:28.028048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:28.038473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:28.039953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:28.050669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 943/1875] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:28.647012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:28.649130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:28.666403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c64036-a0f7-41c1-8f17-9bef1e319129 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:28.674161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:28.675717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:28.676216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:28.676682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] PATH_INFO: `/v3/projects/49bb09cf8e2549598059e38d7f750e1d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:28.679609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bb09cf8e2549598059e38d7f750e1d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:28.687752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:28.866328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bb09cf8e2549598059e38d7f750e1d', 'request_id': 'req-633934b6-a5ed-4a04-ac9c-dd8731dbf394'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:28.874974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bb09cf8e2549598059e38d7f750e1d', 'request_id': 'req-633934b6-a5ed-4a04-ac9c-dd8731dbf394'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:28.886688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bb09cf8e2549598059e38d7f750e1d', 'request_id': 'req-633934b6-a5ed-4a04-ac9c-dd8731dbf394'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:28.988194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] The token cache is being invalidate because project 49bb09cf8e2549598059e38d7f750e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:28.988496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:28.989200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:28.993945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 933/1876] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:28 2022] DELETE /identity/v3/projects/49bb09cf8e2549598059e38d7f750e1d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:28.995303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:29.005606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42719e-a97e-4d5c-97ec-e0ae3ae20d27 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:29.009806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:29.075930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:29.076992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:29.077294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:29.078306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] PATH_INFO: `/v3/users/34849ac0bf74459998c55175752763a0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:29.083272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34849ac0bf74459998c55175752763a0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:29.089946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:29.334878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34849ac0bf74459998c55175752763a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:29.347592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34849ac0bf74459998c55175752763a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:29.349193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34849ac0bf74459998c55175752763a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:29.357507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34849ac0bf74459998c55175752763a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:29.358216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-db394d57-6954-4116-bfbe-2b39a862ccc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34849ac0bf74459998c55175752763a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:29.479388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 944/1877] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:28 2022] DELETE /identity/v3/users/34849ac0bf74459998c55175752763a0 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:30.103664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:30.105574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:30.121098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633934b6-a5ed-4a04-ac9c-dd8731dbf394 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:30.198245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:30.199130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.203891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.203891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] PATH_INFO: `/v3/projects/07256998fd0b4c06b531909a17aea95c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.203891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07256998fd0b4c06b531909a17aea95c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:30.203891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:30.350179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:30.369509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07256998fd0b4c06b531909a17aea95c', 'request_id': 'req-b36cebcd-5070-4505-ba39-b77c93dd6c89'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:30.375935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07256998fd0b4c06b531909a17aea95c', 'request_id': 'req-b36cebcd-5070-4505-ba39-b77c93dd6c89'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:30.381530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07256998fd0b4c06b531909a17aea95c', 'request_id': 'req-b36cebcd-5070-4505-ba39-b77c93dd6c89'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:30.456450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] The token cache is being invalidate because project 07256998fd0b4c06b531909a17aea95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:30.456763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:30.457406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b36cebcd-5070-4505-ba39-b77c93dd6c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:30.458993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 934/1878] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:30 2022] DELETE /identity/v3/projects/07256998fd0b4c06b531909a17aea95c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:30.465821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.466338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.466458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.489923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:30.491256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:30.554977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 945/1879] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:30.567089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.567369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.567660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.587401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:30.588623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:30.597335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 935/1880] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:30.602319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:30.617502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730583a-2f5f-41ac-9c3e-a594d8f15b9f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:30.627328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:30.627328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.627328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.627328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.627820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:30.628171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:30.630451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:30.649534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 946/1881] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:04:30.652144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:30.663141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180bf7-18f6-4516-8615-a1bba32f4ba8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:30.668902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:30.669710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.670031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.670314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.671261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:30.673240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:30.864635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 936/1882] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:30 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:30.870231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:30.883256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492950fe-491e-43c9-a90c-48fea9eeaf91 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:30.895407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:30.953512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:30.954531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:30.954814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:30.955090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:30.955814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:30.957873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.063143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 947/1883] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:30 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:31.068111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.079846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8a04-3127-4015-aa04-5d60b8d8bd66 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.087156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.087968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.088164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.088470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.089226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.090889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.103760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 937/1884] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:31.116070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.130328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf419cd-cf38-4477-8f91-341dd12e4fa1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.136545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.137097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.137312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.137660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.143282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.144479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea42e8-5206-40c3-8693-6356113e98a4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.156998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 948/1885] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:31.161240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.179493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dfeb6-1191-4c2f-b9fa-c463b3b977e8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.183872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.184854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.185205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.185546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] PATH_INFO: `/v3/projects/0f41a98685d34976ba81a12fddbced1a/users/96be66b3a9404bccb6bcd1fd15babdb7/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.202259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f41a98685d34976ba81a12fddbced1a, user_id=96be66b3a9404bccb6bcd1fd15babdb7, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.205306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.306224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 938/1886] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:31 2022] PUT /identity/v3/projects/0f41a98685d34976ba81a12fddbced1a/users/96be66b3a9404bccb6bcd1fd15babdb7/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:31.316748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.317025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.317312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.351735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] MFA Rules not processed for user `96be66b3a9404bccb6bcd1fd15babdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:31.353987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:31.429958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 949/1887] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:31.434384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.516447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaf63d-12c5-4f41-88f2-7666169fa573 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.521424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.522187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.522469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.522830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.524093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.526021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.629255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 939/1888] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:31 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:31.634265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.645447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916451c1-72ef-4bd8-a71f-c89562da7596 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.710630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.711317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.712720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.712720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.712720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.714699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.812415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 950/1889] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:31 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:31.816682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.828048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2257-14af-47da-9c77-64dd48bf9885 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.833367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.835047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.835047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.835047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.835393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.836978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.848268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 940/1890] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:31.853355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:31.865309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1ea26-5c28-4d48-8f86-bde36652a6cb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:31.871412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:31.872358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:31.872642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:31.872918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] PATH_INFO: `/v3/projects/5861959193a74e538c1b40bd8b2f4ea6/users/d7c2e50cd12d4845afb6b91f7a75c9f5/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:31.882599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:31.890554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5861959193a74e538c1b40bd8b2f4ea6, user_id=d7c2e50cd12d4845afb6b91f7a75c9f5, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:31.893252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:31.995730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 951/1891] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:31 2022] PUT /identity/v3/projects/5861959193a74e538c1b40bd8b2f4ea6/users/d7c2e50cd12d4845afb6b91f7a75c9f5/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:31.997267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:32.021704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b33e-a494-4cd1-9ad9-a7d863b31dfb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:32.052076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:32.094169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:32.099752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.099752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.099752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.099752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:32.099752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f7a52-0577-4eed-850e-bde3de5c8e89 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:32.111739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 941/1892] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:32.113046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:32.124442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ef588-8f4a-4d09-a2fb-b8a3de37af63 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:32.129272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:32.130271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.130551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.130826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] PATH_INFO: `/v3/projects/5861959193a74e538c1b40bd8b2f4ea6/users/d7c2e50cd12d4845afb6b91f7a75c9f5/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.133527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5861959193a74e538c1b40bd8b2f4ea6, user_id=d7c2e50cd12d4845afb6b91f7a75c9f5, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:32.136207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:32.147737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 952/1893] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:32 2022] PUT /identity/v3/projects/5861959193a74e538c1b40bd8b2f4ea6/users/d7c2e50cd12d4845afb6b91f7a75c9f5/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:32.158587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.158875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.159161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.207389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] MFA Rules not processed for user `d7c2e50cd12d4845afb6b91f7a75c9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:32.209189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:32.332370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 942/1894] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:32.347679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:32.349482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:32.433545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a30db3-5dc4-4269-951e-8407c55a7a7b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:32.437393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:32.438045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.438335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.438617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.449478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:32.450979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:32.462580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 953/1895] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:04:32.774088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:32.784254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115ef2-23b6-46ea-b23c-0f969c440d68 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:32.788484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:32.789876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.789876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.789876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.809032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:32.812692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:32.853690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:32.856257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014daa1-0376-48dd-9d1e-ddf682e28fbb service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:32.868747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 943/1896] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:32.884984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137024e6-4c4f-40a9-bcff-19a42ceaca2c service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:32.889701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:32.890670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:32.890957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:32.891223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] PATH_INFO: `/v3/users/bed186587f3844cd972a7b7b0a870a76` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:32.892437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed186587f3844cd972a7b7b0a870a76)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:32.894875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:33.080398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed186587f3844cd972a7b7b0a870a76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:33.093443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed186587f3844cd972a7b7b0a870a76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:33.094360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed186587f3844cd972a7b7b0a870a76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:33.102049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed186587f3844cd972a7b7b0a870a76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:33.102600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed186587f3844cd972a7b7b0a870a76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:33.106351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:33.205608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 954/1897] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:32 2022] DELETE /identity/v3/users/bed186587f3844cd972a7b7b0a870a76 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:33.210363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:33.211458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:33.211458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:33.230579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:33.236651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:33.293324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:33.315143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 944/1898] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:33.325525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:33.327105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:33.389257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555e33d-df21-45b8-be77-0fc80a92517b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:33.394395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:33.395406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:33.395934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:33.396418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:33.408475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:33.410282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:33.421620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 955/1899] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:34.260612 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:34.262182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:34.285712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b83c5-5eab-4729-9ac8-1e59c82b3527 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:34.302853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:34.303763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:34.304051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:34.304359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] PATH_INFO: `/v3/projects/ca48e1ded936448a99ff47ef56d4f036` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:34.305676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca48e1ded936448a99ff47ef56d4f036)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:34.307756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:34.471831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca48e1ded936448a99ff47ef56d4f036', 'request_id': 'req-3952f7f4-6849-44db-916e-81ad680210c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:34.480634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca48e1ded936448a99ff47ef56d4f036', 'request_id': 'req-3952f7f4-6849-44db-916e-81ad680210c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:34.491016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca48e1ded936448a99ff47ef56d4f036', 'request_id': 'req-3952f7f4-6849-44db-916e-81ad680210c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:34.605582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] The token cache is being invalidate because project ca48e1ded936448a99ff47ef56d4f036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:34.605874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:34.606615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:34.608741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 945/1900] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:34 2022] DELETE /identity/v3/projects/ca48e1ded936448a99ff47ef56d4f036 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:34.612858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:34.623496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff32d8-360c-4fbf-88fd-4b71783b38c8 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:34.696109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:34.696700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:34.697079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:34.697432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] PATH_INFO: `/v3/users/00a210a21f64406091d11c59883dd1a8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:34.699076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a210a21f64406091d11c59883dd1a8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:34.702120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:34.991355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a210a21f64406091d11c59883dd1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:35.048412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a210a21f64406091d11c59883dd1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:35.056075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a210a21f64406091d11c59883dd1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:35.059684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a210a21f64406091d11c59883dd1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:35.060495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d6c51335-3038-493c-9fc8-3279a2c01e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a210a21f64406091d11c59883dd1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:35.206715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 956/1901] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:34 2022] DELETE /identity/v3/users/00a210a21f64406091d11c59883dd1a8 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:35.880450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:35.883260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:35.917773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f7f4-6849-44db-916e-81ad680210c8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:35.987786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:35.989376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:35.990263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:35.990859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] PATH_INFO: `/v3/projects/72e520f239394a43a7a41d83ec271691` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:35.995055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e520f239394a43a7a41d83ec271691)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:35.998621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:36.243825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e520f239394a43a7a41d83ec271691', 'request_id': 'req-79aa92c6-a944-4b3a-807c-892999281399'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:36.254386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e520f239394a43a7a41d83ec271691', 'request_id': 'req-79aa92c6-a944-4b3a-807c-892999281399'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:36.261452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e520f239394a43a7a41d83ec271691', 'request_id': 'req-79aa92c6-a944-4b3a-807c-892999281399'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:36.372441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:36.378812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] The token cache is being invalidate because project 72e520f239394a43a7a41d83ec271691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:36.379359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:36.380487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-79aa92c6-a944-4b3a-807c-892999281399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:36.387711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 946/1902] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:35 2022] DELETE /identity/v3/projects/72e520f239394a43a7a41d83ec271691 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:36.390607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.391103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.391186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.414229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:36.415861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:36.434755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:36.490357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 957/1903] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:36.498189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.498485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.498773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.531433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:36.532770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:36.547393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 947/1904] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:36.548445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:36.561025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9342874-cd1d-4209-b7bd-f9ebf0e3621f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:36.567111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:36.567929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.568564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.568925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.569845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:36.570304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:36.572245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:36.599362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 958/1905] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:36.606488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:36.619829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea2239-0e3c-4bcd-b1ca-d6b3ed8b41fa None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:36.625734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:36.626777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.627245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.627680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.628408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:36.630486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:36.760384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 948/1906] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:36 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:36.764667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:36.775684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405b70-f78c-4e85-a5ef-8a3ffc00d1a9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:36.837681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:36.838405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.838690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.838965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.839679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:36.841607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:36.954940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 959/1907] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:36 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:36.959787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:36.975852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c03cb-b301-4e0b-b49e-d91917f8ebd6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:36.982395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:36.983252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:36.983594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:36.984008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:36.984678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:36.986343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.001586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 949/1908] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:37.008193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.019692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f910d5-f9b4-4dc1-adc9-f2c21078cfc1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.025705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.026432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.026720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.027007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.027751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.029464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef58ffa-64ad-4747-92bc-6cdbad0b7bb8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.040462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 960/1909] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:37.044916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.055024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a3b6b-6259-4f57-8492-432e8aaff5f7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.059684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.060566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.060848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.061124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] PATH_INFO: `/v3/projects/dad05d33443e4e6c853478a1550b4cba/users/32c4644d01f041838450cbfc5354c52d/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.076632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad05d33443e4e6c853478a1550b4cba, user_id=32c4644d01f041838450cbfc5354c52d, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.079626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.274065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 950/1910] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:37 2022] PUT /identity/v3/projects/dad05d33443e4e6c853478a1550b4cba/users/32c4644d01f041838450cbfc5354c52d/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:37.276305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.276602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.276887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.307080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] MFA Rules not processed for user `32c4644d01f041838450cbfc5354c52d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:37.309251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:37.400252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 961/1911] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:37.410825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.498599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716206b-71b3-4481-b89f-294155231a2d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.507813 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.509029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.509546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.510090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.511329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.515178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.622217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 951/1912] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:37 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:37.625986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.641866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275466dc-fe05-4b7b-8e4e-fd70cb303fa7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.654255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:37.722179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.722874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.723162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.723434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.724159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.727125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.900948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 962/1913] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:37 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:37.906079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.920991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbe72-9d57-4016-bc30-b0c6b82a6100 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.925920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.926697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.927519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.927801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.928556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.930823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:37.942921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 952/1914] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:37.948143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:37.958878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ed98-13f8-40a4-9ad5-0ccae32f2b13 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:37.963533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:37.964424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:37.964701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:37.964971 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] PATH_INFO: `/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f/users/5ef51e300378485e947950a9382d1a27/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:37.984003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0e0d57454e4bfcb68eaf2e4645b84f, user_id=5ef51e300378485e947950a9382d1a27, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:37.986743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:38.081233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 963/1915] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:37 2022] PUT /identity/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f/users/5ef51e300378485e947950a9382d1a27/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:38.090206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:38.101552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d85a8-638e-46b5-ba49-368145c1f106 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:38.178568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:38.179961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:38.180244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:38.180622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:38.181307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:38.182927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e34a-6ecc-44cc-87a3-af08e8de0572 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:38.197733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 953/1916] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:38.199117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:38.211043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57026a7-c560-4196-8c5e-dc115b2a31c1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:38.215963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:38.216874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:38.217162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:38.217443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] PATH_INFO: `/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f/users/5ef51e300378485e947950a9382d1a27/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:38.219522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0e0d57454e4bfcb68eaf2e4645b84f, user_id=5ef51e300378485e947950a9382d1a27, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:38.222282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:38.234642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 964/1917] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:38 2022] PUT /identity/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f/users/5ef51e300378485e947950a9382d1a27/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:38.246758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:38.247050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:38.247364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:38.261473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:38.281417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] MFA Rules not processed for user `5ef51e300378485e947950a9382d1a27`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:38.292600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:38.373649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 954/1918] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:38.374262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:38.374262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:38.434786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102c2b-8c79-40f1-a004-11f3db205ac0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:38.438581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:38.439255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:38.439539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:38.439817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:38.531441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:38.531441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb7d7f-c3da-496f-a77b-94742e8ee679 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:38.531441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 965/1919] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:44.549569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:44.551373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:44.653196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef723-985a-4a3d-b4e7-1640d312c3a6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:44.659428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:44.661173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:44.661173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:44.661173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] PATH_INFO: `/v3/users/96be66b3a9404bccb6bcd1fd15babdb7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:44.663550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96be66b3a9404bccb6bcd1fd15babdb7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:44.666856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:44.937608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96be66b3a9404bccb6bcd1fd15babdb7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:44.969188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96be66b3a9404bccb6bcd1fd15babdb7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:44.970179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96be66b3a9404bccb6bcd1fd15babdb7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:44.979784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96be66b3a9404bccb6bcd1fd15babdb7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:44.981374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96be66b3a9404bccb6bcd1fd15babdb7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.109881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 955/1920] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:44 2022] DELETE /identity/v3/users/96be66b3a9404bccb6bcd1fd15babdb7 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:45.114748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:45.115331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:45.115331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:45.133997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:45.135435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:45.149344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:45.199222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 966/1921] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:45.209493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:45.211225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:45.227430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:45.275501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584bbf-ca79-4317-acd4-3736c900f027 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:45.279305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:45.280269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:45.280551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:45.280868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:45.291432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:45.292886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f92b-8bca-445d-bbb7-946d7e771401 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:45.307198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 956/1922] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:04:45.393329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:45.397368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:45.420033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff83b-efdb-46c3-80b4-750c32c8a879 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:45.428584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:45.434688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:45.434688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:45.434688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] PATH_INFO: `/v3/users/32c4644d01f041838450cbfc5354c52d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:45.434688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c4644d01f041838450cbfc5354c52d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:45.437554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:45.726604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c4644d01f041838450cbfc5354c52d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.750179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c4644d01f041838450cbfc5354c52d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.751158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c4644d01f041838450cbfc5354c52d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.762845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c4644d01f041838450cbfc5354c52d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.764635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c4644d01f041838450cbfc5354c52d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:45.886935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 967/1923] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:45 2022] DELETE /identity/v3/users/32c4644d01f041838450cbfc5354c52d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:45.889437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:45.890448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:45.890900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:45.915663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:45.917432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:46.027877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 957/1924] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:46.052661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:46.055392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:46.083271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:46.087227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:46.103798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee6545-526b-4e29-ac0c-3ecea926f0bb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:46.110052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:46.111096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:46.111421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:46.111649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] PATH_INFO: `/v3/projects/0f41a98685d34976ba81a12fddbced1a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:46.113167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f41a98685d34976ba81a12fddbced1a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:46.116613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:46.197813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e4d5-6a6e-48f4-a52d-2d4828dbc89a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:46.204223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:46.205812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:46.206115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:46.208265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:46.223974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:46.225644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:46.245004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 968/1925] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:46.345944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f41a98685d34976ba81a12fddbced1a', 'request_id': 'req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:46.364531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f41a98685d34976ba81a12fddbced1a', 'request_id': 'req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:46.383505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f41a98685d34976ba81a12fddbced1a', 'request_id': 'req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:46.540723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] The token cache is being invalidate because project 0f41a98685d34976ba81a12fddbced1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:46.541147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:46.542774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:46.548654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 958/1926] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:46 2022] DELETE /identity/v3/projects/0f41a98685d34976ba81a12fddbced1a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:46.550411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:46.575510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6230f-7f52-4eab-95f2-23b34e4bee3d service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:46.685221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:46.721800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:46.723124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:46.723891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:46.724292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] PATH_INFO: `/v3/users/d7c2e50cd12d4845afb6b91f7a75c9f5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:46.726212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c2e50cd12d4845afb6b91f7a75c9f5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:46.731619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:47.009969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c2e50cd12d4845afb6b91f7a75c9f5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.025089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c2e50cd12d4845afb6b91f7a75c9f5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.026170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c2e50cd12d4845afb6b91f7a75c9f5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.035173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c2e50cd12d4845afb6b91f7a75c9f5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.035915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c2e50cd12d4845afb6b91f7a75c9f5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.076884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:47.078596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:47.115052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e33f4-e7b6-489a-972e-d9c8554bb6a7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:47.124755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:47.126357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:47.126879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:47.127719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] PATH_INFO: `/v3/projects/dad05d33443e4e6c853478a1550b4cba` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:47.130025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad05d33443e4e6c853478a1550b4cba)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:47.134661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:47.137114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 969/1927] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:46 2022] DELETE /identity/v3/users/d7c2e50cd12d4845afb6b91f7a75c9f5 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:47.263708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:47.281732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad05d33443e4e6c853478a1550b4cba', 'request_id': 'req-fefa0125-e1aa-418f-999c-d4487e85253f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.286064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad05d33443e4e6c853478a1550b4cba', 'request_id': 'req-fefa0125-e1aa-418f-999c-d4487e85253f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.292838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad05d33443e4e6c853478a1550b4cba', 'request_id': 'req-fefa0125-e1aa-418f-999c-d4487e85253f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.401860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] The token cache is being invalidate because project dad05d33443e4e6c853478a1550b4cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:47.402442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.405438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.413396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 959/1928] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:47 2022] DELETE /identity/v3/projects/dad05d33443e4e6c853478a1550b4cba => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:47.415805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:47.417506 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:47.518660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732743e-f857-4298-a3d2-647c241ed129 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:47.598815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:47.599756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:47.600100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:47.601207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] PATH_INFO: `/v3/users/5ef51e300378485e947950a9382d1a27` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:47.602518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef51e300378485e947950a9382d1a27)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:47.604764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:47.608548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:47.778921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:47.780498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:47.797245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0125-e1aa-418f-999c-d4487e85253f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:47.806627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:47.807438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:47.807799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:47.808089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] PATH_INFO: `/v3/projects/5861959193a74e538c1b40bd8b2f4ea6` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:47.809343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5861959193a74e538c1b40bd8b2f4ea6)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:47.811485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:47.877701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef51e300378485e947950a9382d1a27'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.892740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef51e300378485e947950a9382d1a27'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.899152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef51e300378485e947950a9382d1a27'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.904115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef51e300378485e947950a9382d1a27'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.904818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-43922ad0-d79d-4fdb-acad-850b55575403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef51e300378485e947950a9382d1a27'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.940484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5861959193a74e538c1b40bd8b2f4ea6', 'request_id': 'req-47f9ad06-1224-4a77-b26e-459f718c8ceb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.947850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5861959193a74e538c1b40bd8b2f4ea6', 'request_id': 'req-47f9ad06-1224-4a77-b26e-459f718c8ceb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:47.953460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5861959193a74e538c1b40bd8b2f4ea6', 'request_id': 'req-47f9ad06-1224-4a77-b26e-459f718c8ceb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:48.021132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 970/1929] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:47 2022] DELETE /identity/v3/users/5ef51e300378485e947950a9382d1a27 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:48.103684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] The token cache is being invalidate because project 5861959193a74e538c1b40bd8b2f4ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:48.105080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:48.105973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-47f9ad06-1224-4a77-b26e-459f718c8ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:48.112291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 960/1930] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:47 2022] DELETE /identity/v3/projects/5861959193a74e538c1b40bd8b2f4ea6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:48.113603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.113603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.113852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.134903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:48.136038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:48.199719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 971/1931] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:48.208040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.208343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.208612 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.255973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:48.259643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:48.271198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 961/1932] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:48.276852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.294160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894b9a6-b5a0-41e6-b150-0cd356e4e809 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.303774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:48.305702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.306355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.307355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.308648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:48.309188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:48.316750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:48.357538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 972/1933] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:48.359114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.387932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef55722-23cc-4511-bcfa-99b0caf8a8f5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.393948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:48.395102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.395749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.396047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.397562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:48.400900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:48.535236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 962/1934] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:48 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:48.539225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.550252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e66bd-70b1-40ac-ab2a-34cd5db8a584 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.623435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:48.624235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.624609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.624952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.625734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:48.628261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:48.647261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.650252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:48.668137 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49879d97-28e1-4a88-80ae-4ef6ea543cf4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.674939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:48.677849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.678596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.678868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] PATH_INFO: `/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.680964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0e0d57454e4bfcb68eaf2e4645b84f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:48.683437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:48.798319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:48.808970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 973/1935] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:48 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:48.811249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.848333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab8b10-be53-49e7-8f7c-aa3fcbf17101 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.858510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:48.859204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:48.859486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:48.859759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:48.861329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:48.862295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:48.908544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 974/1936] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:48.916925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:48.954258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42e5bd-c4fa-463a-8d0f-11562da5e1eb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:48.958578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0e0d57454e4bfcb68eaf2e4645b84f', 'request_id': 'req-14bbc4a8-61f4-440b-aca9-895508651804'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:48.973435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0e0d57454e4bfcb68eaf2e4645b84f', 'request_id': 'req-14bbc4a8-61f4-440b-aca9-895508651804'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:48.992477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0e0d57454e4bfcb68eaf2e4645b84f', 'request_id': 'req-14bbc4a8-61f4-440b-aca9-895508651804'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.077084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.077961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.078255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.078538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.079367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.081636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.096372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:49.103544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 975/1937] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:49.109958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.122202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] The token cache is being invalidate because project bb0e0d57454e4bfcb68eaf2e4645b84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:49.124541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.125949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-14bbc4a8-61f4-440b-aca9-895508651804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:49.131826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6340-020a-4009-8e43-d725ebffbf7f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.134659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 963/1938] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:48 2022] DELETE /identity/v3/projects/bb0e0d57454e4bfcb68eaf2e4645b84f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:49.142508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e85b-c01c-42ea-af79-045c90ebabf3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.143527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e85b-c01c-42ea-af79-045c90ebabf3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.144624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e85b-c01c-42ea-af79-045c90ebabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.147830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.149541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.149848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.150528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] PATH_INFO: `/v3/projects/06eea3ca15574bb49be23f075def7d30/users/47358ccfac064e0fa1e86fa0ff004c75/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.172032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eea3ca15574bb49be23f075def7d30, user_id=47358ccfac064e0fa1e86fa0ff004c75, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.174884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14c68d-9913-4c79-bf93-8cb6174ff5a8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.177326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-34c7e85b-c01c-42ea-af79-045c90ebabf3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:49.178619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-34c7e85b-c01c-42ea-af79-045c90ebabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:49.186859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 964/1939] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:49.196192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.196481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.196764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.219081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:49.220326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:49.235975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 965/1940] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:49.237947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.261319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a06c-74e2-42d6-81f6-9d88327af6bb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.267506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.268269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.268558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.268834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.269610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:49.269982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.271704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.284050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 976/1941] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:49 2022] PUT /identity/v3/projects/06eea3ca15574bb49be23f075def7d30/users/47358ccfac064e0fa1e86fa0ff004c75/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:49.289881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.290475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.290944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.293831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 966/1942] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:04:49.298199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.313544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb38-e4f5-4d6e-8184-a16f0946c825 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.315888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:49.317234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:49.389081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.389734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.390063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.390349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.391888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.393858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.402518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 977/1943] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:49.415152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.417502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:49.483505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d018-6987-4bdd-8fa7-ba9fc654218a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.487538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.488207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.488632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.488906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.500656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.510103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.510436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 967/1944] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:49.512634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.516139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 978/1945] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:49.598986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d7d25-fced-4dc1-aaf4-43442ee3285b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.605310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.605461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.605680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.605998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.606757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.608778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.753096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 968/1946] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:49.757395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.768314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed153-1955-489a-bb87-057c8c1c904f service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.775704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.776528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.776950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.777327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.778188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.780576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.799657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 979/1947] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:49.803877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.818034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb09da-2cf7-4c76-a93e-bcc690a093de admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.827187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.828323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.828823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.829369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.831049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.834459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef3352-964b-47dd-a16e-b79cc581bba1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.852685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 969/1948] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:49.857055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:49.868684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911b8f8-147d-47ce-89df-000e44ec2fe9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:49.875194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:49.876142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.876428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.876707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] PATH_INFO: `/v3/projects/9f9ac73d84244b1c9029586fa4969bbf/users/107ed6d5d4524a29a1c545cba5e8f5bf/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:49.899555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9ac73d84244b1c9029586fa4969bbf, user_id=107ed6d5d4524a29a1c545cba5e8f5bf, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:49.899987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:49.981987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 980/1949] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:49 2022] PUT /identity/v3/projects/9f9ac73d84244b1c9029586fa4969bbf/users/107ed6d5d4524a29a1c545cba5e8f5bf/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:49.986309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:49.986613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:49.986945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.014141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:50.014141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.119073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 970/1950] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:50.135518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.137758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.146269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.180856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e257-1af3-4a45-a508-f671cb0e01d9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.189063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.190604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.191062 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.191744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] PATH_INFO: `/v3/users/c17da591bb5b4170a962fc8b518bbfb7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.195566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17da591bb5b4170a962fc8b518bbfb7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.199006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.293257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c5482-00c2-4b9e-9664-4abf589d87bb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.298978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.299745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.300092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.300702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.315102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.316720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbd58d-1ab1-4677-9dc0-8943df2ef6c2 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.333060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 971/1951] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:50.466173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17da591bb5b4170a962fc8b518bbfb7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.481230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17da591bb5b4170a962fc8b518bbfb7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.482292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17da591bb5b4170a962fc8b518bbfb7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.491782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17da591bb5b4170a962fc8b518bbfb7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.491782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17da591bb5b4170a962fc8b518bbfb7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:50.600379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 981/1952] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:04:50 2022] DELETE /identity/v3/users/c17da591bb5b4170a962fc8b518bbfb7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:50.605802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0434-b1d8-41c8-bb2b-0315de1b9813 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.606117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0434-b1d8-41c8-bb2b-0315de1b9813 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.606403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0434-b1d8-41c8-bb2b-0315de1b9813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.625845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c5bc0434-b1d8-41c8-bb2b-0315de1b9813 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:50.627121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c5bc0434-b1d8-41c8-bb2b-0315de1b9813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.641029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:50.700491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 972/1953] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:50.711625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:50.713753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:50.800825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7163-e6fb-4fc4-b9e6-3a5c012bf753 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:50.805644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:50.807543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:50.807966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:50.808654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:50.821560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:50.823221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:50.834920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 982/1954] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:04:50.950217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:51.449034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:51.451236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:51.451566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.500793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] MFA Rules not processed for user `47358ccfac064e0fa1e86fa0ff004c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:51.502301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:51.615848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 973/1955] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:51.622070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:51.624776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:51.642272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510f9b-48b2-48fe-ad1d-34960fd81a8c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:51.647142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:51.647867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:51.648112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:51.648445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.649175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:51.651273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:51.756994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:51.760118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 983/1956] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:51 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:51.763923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:51.765475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:51.803262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf84b-0fd2-480d-aca5-085f98834073 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:51.895830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:51.896741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:51.897170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:51.897482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] PATH_INFO: `/v3/projects/e99ab3a635584abbad643411c3567295` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.899352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99ab3a635584abbad643411c3567295)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:51.901283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:51.903992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61571-0d20-4dd2-b401-b6690ace9a22 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:51.908836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:51.909535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:51.909833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:51.910141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:51.910857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:51.912892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.021012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:52.073450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 984/1957] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:51 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:52.082892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.094595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e074-04ad-4550-9f24-bc0ba8bb48e2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.103864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.106941 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.109642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.110990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.112084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.113460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.127139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99ab3a635584abbad643411c3567295', 'request_id': 'req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:52.134963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99ab3a635584abbad643411c3567295', 'request_id': 'req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:52.136147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 985/1958] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:52.140866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.142314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99ab3a635584abbad643411c3567295', 'request_id': 'req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:52.154492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1aad9-1d46-429a-a2ce-7c8e821e8f71 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.205680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:52.229805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.230805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.231115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.231391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] PATH_INFO: `/v3/projects/469a666bd69248bdab29bb491d5a213a/users/45baf18eb92b467891a0243832b822f2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.242951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] The token cache is being invalidate because project e99ab3a635584abbad643411c3567295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:04:52.243325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:52.244060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-60ab97d7-7d2f-4029-9ff5-8798bbe226ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:04:52.245924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 974/1959] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:04:51 2022] DELETE /identity/v3/projects/e99ab3a635584abbad643411c3567295 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:52.247873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] RBAC: Authorizing `identity:create_grant(project_id=469a666bd69248bdab29bb491d5a213a, user_id=45baf18eb92b467891a0243832b822f2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.253137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.253262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc97d-5e57-48b1-88ed-4cfa17047dac None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.253262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc97d-5e57-48b1-88ed-4cfa17047dac None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.253262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc97d-5e57-48b1-88ed-4cfa17047dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.271976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-004dc97d-5e57-48b1-88ed-4cfa17047dac None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:52.273144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-004dc97d-5e57-48b1-88ed-4cfa17047dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:52.281952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 975/1960] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:52.291161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.291455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.291737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.310992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:52.312245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:52.320536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 976/1961] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:52.324867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.335489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a49d2-32d5-4e4e-8236-40bdb1620cd4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.341574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.342303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.342955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.342955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.344163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:04:52.344163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.345627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.364747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 986/1962] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:52 2022] PUT /identity/v3/projects/469a666bd69248bdab29bb491d5a213a/users/45baf18eb92b467891a0243832b822f2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:52.365811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.369152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:52.372018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 977/1963] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:04:52.376603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.392554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91fe2-244d-4d80-a79b-5cafa2245d77 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.462009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6f4e6-1499-4025-b3b0-357be49c075e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.472306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.473265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.473654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.474076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.474943 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.477031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.492877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.494134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.494647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.495570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.498403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.502339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 987/1964] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:52.506127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.508781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.518969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd62ac-9611-4097-b72b-ceea27bd1b06 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.523986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.524897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.525177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.525509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] PATH_INFO: `/v3/projects/469a666bd69248bdab29bb491d5a213a/users/45baf18eb92b467891a0243832b822f2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.527617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=469a666bd69248bdab29bb491d5a213a, user_id=45baf18eb92b467891a0243832b822f2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.530364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.541725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 988/1965] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:52 2022] PUT /identity/v3/projects/469a666bd69248bdab29bb491d5a213a/users/45baf18eb92b467891a0243832b822f2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:52.608193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:52.621335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 978/1966] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:52.627520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.719196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e09692-f259-402b-843d-fd7de672ca6f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.821627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.822410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.822776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.823527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.823927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.826162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.915290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 989/1967] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:52 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:52.916782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.927628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021182e-f5ed-44c6-a4b3-4a2ffee835e4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.933214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.933920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.934204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.934482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.935223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.936847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.948355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 979/1968] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:52.953749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:52.968361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661f23-af53-43dc-ad5d-d55a89c2b127 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:52.973879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:52.974605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:52.974947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:52.975235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:52.976010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:52.977639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ae96-e692-4420-a1d6-6b5709ac6f9d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:52.989034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 990/1969] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:52.994086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:53.005094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc1a5-1ec8-4ab6-ab0d-14028f51d9d1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:53.011279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:53.012325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.013078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.013078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] PATH_INFO: `/v3/projects/7246345d0a3840e3bfbb2963480abc6d/users/c453f4b2e82d4c62bd41bce83c6cd44a/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.032890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7246345d0a3840e3bfbb2963480abc6d, user_id=c453f4b2e82d4c62bd41bce83c6cd44a, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:53.036353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:53.252041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 980/1970] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:52 2022] PUT /identity/v3/projects/7246345d0a3840e3bfbb2963480abc6d/users/c453f4b2e82d4c62bd41bce83c6cd44a/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:53.254725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.255031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.256108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.285671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] MFA Rules not processed for user `c453f4b2e82d4c62bd41bce83c6cd44a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:53.286950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:53.392786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 991/1971] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:53.393976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:53.515154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eb391-07b0-4ea5-b605-9453fb642f9e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:53.520464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:53.521420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.521755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.522219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.522990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:53.525678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:53.687377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 981/1972] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:53 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:53.708626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:53.720815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02158aa7-6562-4ef8-b10e-e6142e93d93a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:53.762002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:53.799063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:53.799883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.800235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.800622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.801423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:53.808193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:53.924749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 992/1973] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:53 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:53.939238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:53.951838 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7d39-38a8-49bb-9335-e4803c3014db admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:53.960729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:53.962582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:53.963107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:53.963625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:53.965086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:53.967626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:53.983426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 982/1974] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:53.988867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:54.016342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ba2fb-25da-41aa-86b8-f45a878fcb7e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:54.024130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:54.025412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:54.025855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:54.026670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:54.028136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:54.030653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19ab74-6ec9-4787-90f2-902d6fb57af6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:54.056507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 993/1975] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:54.057784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:54.079469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afbce5-6ffc-4537-a55a-fa2865359960 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:54.090368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:54.092006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:54.092406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:54.092849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] PATH_INFO: `/v3/projects/df0d206ee69045b9bab5e38cb4d72133/users/c0b1de5fdd424245a82166595745ec15/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:54.123073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0d206ee69045b9bab5e38cb4d72133, user_id=c0b1de5fdd424245a82166595745ec15, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:54.126320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:54.290426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 983/1976] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:54 2022] PUT /identity/v3/projects/df0d206ee69045b9bab5e38cb4d72133/users/c0b1de5fdd424245a82166595745ec15/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:54.306809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:54.307355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:54.307817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:54.341123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] MFA Rules not processed for user `c0b1de5fdd424245a82166595745ec15`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:54.342407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:54.434071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 994/1977] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:54.435100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:54.538650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d1b5b-525e-443e-a517-421e9131f3b9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:54.550717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:54.551433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:54.551941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:54.552268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:54.553169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:54.555292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:54.730213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:54.741390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 984/1978] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:54 2022] POST /identity/v3/projects => generated 375 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:54.748214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:54.770426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c2c2-9644-434e-b8a2-4be16a073814 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:54.836874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:54.837821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:54.838401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:54.838882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:54.839744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:54.842420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.011904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 995/1979] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:54 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:55.017158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.035882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daac83-46df-4e2f-bf07-3f072ac1b05d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.044378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.045827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.048410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.049196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.051036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.058975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddcca9-7448-4fce-b8ab-03e051ffa7b5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.085152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 985/1980] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:55.092662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.101033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.101468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.101928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.136171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4425a-eac0-4159-a90a-26497f76c161 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.168702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.174409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.178905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] MFA Rules not processed for user `45baf18eb92b467891a0243832b822f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:55.180456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.181375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.181671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] PATH_INFO: `/v3/projects/c426665281704eb889963baae2338a12/users/8a12fa7df1fd4721a02327571598193b/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.243913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:55.261629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c426665281704eb889963baae2338a12, user_id=8a12fa7df1fd4721a02327571598193b, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.264548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.326187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 986/1981] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:55.335633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.340211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.365935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 996/1982] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:55 2022] PUT /identity/v3/projects/c426665281704eb889963baae2338a12/users/8a12fa7df1fd4721a02327571598193b/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:55.365935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.507477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5a6a2-4c51-46b7-a922-d7eba8a8ceba None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.570809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74a8b-d792-463e-8442-22909fb67103 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.580973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.581910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.582601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.583090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.584372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.592308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.608236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 997/1983] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:04:55.612984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.623445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.624286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.627033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.627033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.628778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.630650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce4b91-2da0-463d-98f1-0da54cf08cd1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:55.636823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:55.637973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.638324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.638705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] PATH_INFO: `/v3/projects/c426665281704eb889963baae2338a12/users/8a12fa7df1fd4721a02327571598193b/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.641531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c426665281704eb889963baae2338a12, user_id=8a12fa7df1fd4721a02327571598193b, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.644459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264471-cf93-460f-a24a-f0c7f30dfab7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.657701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 998/1984] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:55 2022] PUT /identity/v3/projects/c426665281704eb889963baae2338a12/users/8a12fa7df1fd4721a02327571598193b/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:04:55.677955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597c0f5-b6a1-4a11-85f0-1cf4c45b8813 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:55.678623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597c0f5-b6a1-4a11-85f0-1cf4c45b8813 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:55.678910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597c0f5-b6a1-4a11-85f0-1cf4c45b8813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:55.730495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3597c0f5-b6a1-4a11-85f0-1cf4c45b8813 None None] MFA Rules not processed for user `8a12fa7df1fd4721a02327571598193b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:55.734162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3597c0f5-b6a1-4a11-85f0-1cf4c45b8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.746267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:55.774050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:55.778070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:55.799717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 987/1985] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:04:55.876619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 999/1986] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:04:55.894246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:55.897965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:55.909083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:55.924601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090230cb-193e-4cba-8e48-b94d806ba0a5 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:56.016357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:56.017934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:56.018285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:56.018891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:56.120782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:56.122590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:56.136664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 988/1987] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:04:58.862761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:58.863514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:58.863777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:58.907036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] MFA Rules not processed for user `107ed6d5d4524a29a1c545cba5e8f5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:04:58.908782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:58.984838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:59.021977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1000/1988] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:04:59.028990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.031365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:04:59.138926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39451-6153-48e6-b5f1-25e6c248d299 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.143880 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.144573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.144856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.145145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.145869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.147907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.248607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 989/1989] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:04:59.253396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.266304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db7731-7a1d-4770-8a4f-264bba881553 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.330644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.331326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.331615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.331887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.332597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.334678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.428659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1001/1990] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:04:59 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:04:59.434037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.443069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219966-ad7f-40d6-bcea-65a505d91d42 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.466731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.466731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.466731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.466731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.469276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.469276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.487777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 990/1991] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:59.488169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.500201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f669dc-1ad8-4cd4-b554-c5fb8a5136fd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.511657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.513035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.513629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.514238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] PATH_INFO: `/v3/projects/27a0be1912904cfab18f0faadd40af9e/users/89ca4a8f01e649069947c4771373de97/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.546120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a0be1912904cfab18f0faadd40af9e, user_id=89ca4a8f01e649069947c4771373de97, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.551994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.639853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1002/1992] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:59 2022] PUT /identity/v3/projects/27a0be1912904cfab18f0faadd40af9e/users/89ca4a8f01e649069947c4771373de97/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:04:59.641243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.654503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cd91-d537-4c3c-b5e3-6f25cd8fd003 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.675256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:04:59.761242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.761242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.761242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.761242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.762833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.764187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.798029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 991/1993] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:04:59.798239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:04:59.810401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5a9a-e277-4b79-8abd-ca3ad2d3d4dc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:04:59.817290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:04:59.818135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:04:59.818597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:04:59.819168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] PATH_INFO: `/v3/projects/27a0be1912904cfab18f0faadd40af9e/users/89ca4a8f01e649069947c4771373de97/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:04:59.821649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a0be1912904cfab18f0faadd40af9e, user_id=89ca4a8f01e649069947c4771373de97, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:04:59.825953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:04:59.840730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1003/1994] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:04:59 2022] PUT /identity/v3/projects/27a0be1912904cfab18f0faadd40af9e/users/89ca4a8f01e649069947c4771373de97/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:02.282000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:02.426683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711017a-8b00-40b4-8a3f-fc59ae15da3e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:02.593560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:02.599085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:02.599669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:02.600101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:02.706759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:02.714789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:02.781480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 992/1995] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:03.432927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:03.453653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c5a89-109f-4ef6-95e6-32d08fa9d353 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:03.461610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:03.462766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:03.463154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:03.463442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:03.632814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:03.638731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6ca28-8c24-40c7-b927-b6d11997cd18 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:03.701652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1004/1996] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:06.830867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:06.841976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6df39-c954-4e29-b45b-b02f89584432 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:06.846139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:06.846811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:06.847155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:06.847436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:06.860105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:06.930843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:06.932793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:06.958677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 993/1997] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:09.067888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a0a20-0429-4539-bb8d-a0c0561461b4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:09.068776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a0a20-0429-4539-bb8d-a0c0561461b4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:09.068776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a0a20-0429-4539-bb8d-a0c0561461b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:09.124113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-909a0a20-0429-4539-bb8d-a0c0561461b4 None None] MFA Rules not processed for user `89ca4a8f01e649069947c4771373de97`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:09.125559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-909a0a20-0429-4539-bb8d-a0c0561461b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:09.178353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:09.264183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1005/1998] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:09.293218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:09.295218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:09.464373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922876-003a-4e8a-aa07-8ef9c6880423 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:09.464373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:09.464373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:09.464373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:09.467404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:09.628122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:09.630930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:09.666427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 994/1999] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:10.314994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622911-9bed-47fb-a654-162d560eaafc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:10.315683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622911-9bed-47fb-a654-162d560eaafc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:10.315904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622911-9bed-47fb-a654-162d560eaafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:10.343970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a622911-9bed-47fb-a654-162d560eaafc None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:10.346076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a622911-9bed-47fb-a654-162d560eaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:10.457538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1006/2000] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:10.515592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:10.518015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:10.643692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:10.653253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e566d-aeb0-4382-93ae-beaf4e1b6fa0 service glance] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:10.666000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:10.685657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:10.686441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:10.687621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:10.709726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:10.713212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9b9ce-f733-46bd-882a-bcccf745b393 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:10.733267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 995/2001] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:05:13.994697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:14.000577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:14.000577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:14.000577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1007/2002] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:05:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:05:14.046466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:14.048868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:14.049399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:14.098679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] MFA Rules not processed for user `a8b4d719ef17413e8f7c69f84348851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:14.099932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:14.305126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:14.308021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:14.372770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 996/2003] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:14.416218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:14.418701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:14.459698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557a11-a50a-4a3d-854b-60a670be47fd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:14.474022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:14.475170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:14.476357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:14.476901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:14.489680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715bff9-288c-4d10-b797-074aad1dc463 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:14.498350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:14.500241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:14.501036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:14.504508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] PATH_INFO: `/v3/users/d5b358c38b5a44d798f7f53c4b318134` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:14.507957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b358c38b5a44d798f7f53c4b318134)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:14.512369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:14.520525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:14.522788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:14.564455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 997/2004] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:15.161001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b358c38b5a44d798f7f53c4b318134'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:15.229527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b358c38b5a44d798f7f53c4b318134'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:15.230896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b358c38b5a44d798f7f53c4b318134'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:15.261107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b358c38b5a44d798f7f53c4b318134'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:15.263797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b358c38b5a44d798f7f53c4b318134'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:15.271659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:15.432077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1008/2005] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:14 2022] DELETE /identity/v3/users/d5b358c38b5a44d798f7f53c4b318134 => generated 0 bytes in 1114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:15.778481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:15.838665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0a0ad-9182-40c1-bf8d-51e9a77fd0bd service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:16.063320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:16.063927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:16.129206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:16.130404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:16.130669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:16.130951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] PATH_INFO: `/v3/users/c453f4b2e82d4c62bd41bce83c6cd44a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:16.134881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c453f4b2e82d4c62bd41bce83c6cd44a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:16.137108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:16.379059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598999ab-31f8-4af0-862c-9d55ca6f1217 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:16.392496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:16.393639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:16.394074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:16.409412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] PATH_INFO: `/v3/projects/96f91ac37f864ed98a03f9082252e334` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:16.409412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f91ac37f864ed98a03f9082252e334)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:16.409412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:16.535195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c453f4b2e82d4c62bd41bce83c6cd44a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:16.543909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:16.562290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c453f4b2e82d4c62bd41bce83c6cd44a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:16.564513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c453f4b2e82d4c62bd41bce83c6cd44a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:16.584985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c453f4b2e82d4c62bd41bce83c6cd44a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:16.586076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-faabd163-79ed-489c-b323-aa2330ce75cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c453f4b2e82d4c62bd41bce83c6cd44a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:16.992151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 998/2006] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:15 2022] DELETE /identity/v3/users/c453f4b2e82d4c62bd41bce83c6cd44a => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:17.000246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.002215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.002997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.005321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f91ac37f864ed98a03f9082252e334', 'request_id': 'req-d77e9cf5-6509-4309-ad0b-244073c27a1e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:17.062463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:17.064828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:17.110107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f91ac37f864ed98a03f9082252e334', 'request_id': 'req-d77e9cf5-6509-4309-ad0b-244073c27a1e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:17.150072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f91ac37f864ed98a03f9082252e334', 'request_id': 'req-d77e9cf5-6509-4309-ad0b-244073c27a1e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:17.256244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] The token cache is being invalidate because project 96f91ac37f864ed98a03f9082252e334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:17.256726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:17.259901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77e9cf5-6509-4309-ad0b-244073c27a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:17.267096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1009/2007] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:16 2022] DELETE /identity/v3/projects/96f91ac37f864ed98a03f9082252e334 => generated 0 bytes in 1205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:17.275284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a606dd-d3dc-45e6-afbd-3cc03de848e0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.275673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a606dd-d3dc-45e6-afbd-3cc03de848e0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.283166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a606dd-d3dc-45e6-afbd-3cc03de848e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.300541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 999/2008] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:17.319059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:17.322810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:17.339806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d5a606dd-d3dc-45e6-afbd-3cc03de848e0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:17.343043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5a606dd-d3dc-45e6-afbd-3cc03de848e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:17.370364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1010/2009] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:17.379056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.394921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.396140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.440349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:17.443179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:17.463879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1011/2010] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:17.471818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:17.511099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c139d-74a1-4c1c-83ff-d5552a923ef1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:17.530389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:17.532673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.533808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.534468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.536344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:17.537758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:17.542376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:17.598406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1012/2011] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:17.604739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:17.617312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172248-b54a-491b-950a-1f7dc57bfff8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:17.628025 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecd13-1ef4-4fad-8809-891715b4fdb1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:17.637861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:17.639350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.639790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.640530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.641826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:17.645417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:17.651604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:17.652468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:17.652898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:17.653174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:17.684629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:17.688081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:17.711157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1000/2012] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:17.826678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1013/2013] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:17 2022] POST /identity/v3/projects => generated 357 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:17.832781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:17.862432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879de6-99bc-4b43-a6c4-b018b59cd0c9 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:17.957878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:18.012497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:18.014570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:18.015250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:18.016479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:18.017679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:18.022394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:18.205973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1001/2014] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:17 2022] POST /identity/v3/users => generated 279 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:18.206655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:18.237727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ea63-ba64-4410-a31b-35221f5355a9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:18.256550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:18.257699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:18.259684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:18.260318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:18.261743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:18.264242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:18.324696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1014/2015] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:18.330415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:18.362958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9012d-4a74-4f80-8eee-86482b664ec1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:18.380247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:18.382693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:18.383540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:18.384150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:18.385666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:18.394765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052facf1-6092-4f16-8a5d-8da660f4079d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:18.454502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1002/2016] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:18.458459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:18.522187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eceedb-025e-472f-9a38-a422ac314c0b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:18.531721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:18.532942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:18.533422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:18.533874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] PATH_INFO: `/v3/projects/695d1df975824227b9c19083bbf02adf/users/78ea5c908b544c9a8e138187df6e37db/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:18.560895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695d1df975824227b9c19083bbf02adf, user_id=78ea5c908b544c9a8e138187df6e37db, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:18.564542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:18.694712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1015/2017] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:18 2022] PUT /identity/v3/projects/695d1df975824227b9c19083bbf02adf/users/78ea5c908b544c9a8e138187df6e37db/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:18.715206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:18.718063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:18.718721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:18.782897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] MFA Rules not processed for user `78ea5c908b544c9a8e138187df6e37db`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:18.785014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:18.802411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:18.805444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:18.884370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:19.000866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79545345-4b2a-4b7f-bc11-92027ad5b752 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.012716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.014225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.014678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.015088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] PATH_INFO: `/v3/projects/7246345d0a3840e3bfbb2963480abc6d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.017424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7246345d0a3840e3bfbb2963480abc6d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.021444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.063517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1003/2018] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:19.071764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.102601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6a49b-9b09-4b2d-8226-1664c7fe49a1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.111499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.119357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.119357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.119357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.119357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.119357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.230275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7246345d0a3840e3bfbb2963480abc6d', 'request_id': 'req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.254099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1004/2019] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:19 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:19.260505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.356705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7246345d0a3840e3bfbb2963480abc6d', 'request_id': 'req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.407833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7246345d0a3840e3bfbb2963480abc6d', 'request_id': 'req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.454204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] The token cache is being invalidate because project 7246345d0a3840e3bfbb2963480abc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:19.454497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.456357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.461733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1016/2020] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:18 2022] DELETE /identity/v3/projects/7246345d0a3840e3bfbb2963480abc6d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:19.463356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.466878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:19.528982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff80c1c-b02c-4f98-ac3d-2959cb32eb83 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.530224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.533577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.533577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.533577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.533577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.536418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.595524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4af4b-5cf9-464d-8b7e-b7aa0a905423 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.606570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.609363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.609839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.610341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] PATH_INFO: `/v3/users/c0b1de5fdd424245a82166595745ec15` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.613885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b1de5fdd424245a82166595745ec15)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.616218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.647723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1005/2021] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:19 2022] POST /identity/v3/users => generated 285 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:19.653050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.657274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:19.693155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f2d37-3d1f-499b-b669-22ba8e01de90 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.702385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.703190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.703473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.703747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.704623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.706721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.724530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1006/2022] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:19.725766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.731987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:19.740333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ed473-79e7-4acb-ba1e-94b8988ff263 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:19.747614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:19.749700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:19.749700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:19.750079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] PATH_INFO: `/v3/projects/da43b57caa19481296df143e17f7e186/users/26b2fc6f8fa3488cbeb88c8808b92714/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:19.829967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da43b57caa19481296df143e17f7e186, user_id=26b2fc6f8fa3488cbeb88c8808b92714, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:19.835187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:19.847735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b1de5fdd424245a82166595745ec15'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.850505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:19.866553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b1de5fdd424245a82166595745ec15'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.867626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b1de5fdd424245a82166595745ec15'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.877946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b1de5fdd424245a82166595745ec15'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.879094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b1de5fdd424245a82166595745ec15'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:19.941961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1007/2023] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:19 2022] PUT /identity/v3/projects/da43b57caa19481296df143e17f7e186/users/26b2fc6f8fa3488cbeb88c8808b92714/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:19.948708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:19.951967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:19.979042 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1017/2024] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:19 2022] DELETE /identity/v3/users/c0b1de5fdd424245a82166595745ec15 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:20.155196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871271-e7fa-42d9-aeba-1ac9a6cc8f94 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:20.245937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:20.246919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:20.247323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:20.247895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:20.248926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:20.250701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66cb53-3e60-4785-9b0b-95ef6d14d7f3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:20.274840 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:20.281944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1008/2025] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:20.295102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b55-deb4-40b3-80cb-531c59c12c38 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:20.300820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:20.301777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:20.303184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:20.303184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] PATH_INFO: `/v3/projects/da43b57caa19481296df143e17f7e186/users/26b2fc6f8fa3488cbeb88c8808b92714/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:20.305458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=da43b57caa19481296df143e17f7e186, user_id=26b2fc6f8fa3488cbeb88c8808b92714, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:20.308773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:20.338135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1018/2026] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:20 2022] PUT /identity/v3/projects/da43b57caa19481296df143e17f7e186/users/26b2fc6f8fa3488cbeb88c8808b92714/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:20.340029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:20.340394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:20.340686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:20.384207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] MFA Rules not processed for user `26b2fc6f8fa3488cbeb88c8808b92714`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:20.386242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:20.581940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1009/2027] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:20.594456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:20.596842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:20.749318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03f61-0f5b-4d34-9876-ae43689d18ab admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:20.757313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:20.762061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:20.762688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:20.763105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:20.800274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:20.801789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:20.814731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1019/2028] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:21.063194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:21.065298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:21.079996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:21.313250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006582c-a5af-4fe6-a042-18e13f0a362f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:21.314381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:21.323386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:21.323998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf414d-1860-47e4-a721-5116fb3ae6c9 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:21.325150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:21.325568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:21.326199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] PATH_INFO: `/v3/projects/df0d206ee69045b9bab5e38cb4d72133` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:21.328312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0d206ee69045b9bab5e38cb4d72133)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:21.328492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:21.329366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:21.329649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:21.330249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:21.332325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:21.333301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:21.459192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:21.462116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:21.498549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1020/2029] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:22.101738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0d206ee69045b9bab5e38cb4d72133', 'request_id': 'req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.109857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0d206ee69045b9bab5e38cb4d72133', 'request_id': 'req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.120099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0d206ee69045b9bab5e38cb4d72133', 'request_id': 'req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.235083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] The token cache is being invalidate because project df0d206ee69045b9bab5e38cb4d72133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:22.235083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.236438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.239170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1010/2030] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:21 2022] DELETE /identity/v3/projects/df0d206ee69045b9bab5e38cb4d72133 => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:22.243844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:22.287811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f62b5-98dc-4792-9680-47c330f19db1 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:22.393875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:22.408726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:22.409845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:22.410164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:22.410445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] PATH_INFO: `/v3/users/8a12fa7df1fd4721a02327571598193b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:22.411776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a12fa7df1fd4721a02327571598193b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:22.413754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:22.682536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a12fa7df1fd4721a02327571598193b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.701709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a12fa7df1fd4721a02327571598193b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.702737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a12fa7df1fd4721a02327571598193b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.712635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a12fa7df1fd4721a02327571598193b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.714098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3a1b787e-260c-4104-8a2a-7b9b561c0b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a12fa7df1fd4721a02327571598193b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:22.847226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1021/2031] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:22 2022] DELETE /identity/v3/users/8a12fa7df1fd4721a02327571598193b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:23.583461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:23.585430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:23.631469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d466b2-fe5b-4e92-92bf-1c1827b77d41 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:23.775269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:23.776300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:23.776664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:23.777016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] PATH_INFO: `/v3/projects/c426665281704eb889963baae2338a12` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:23.778429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c426665281704eb889963baae2338a12)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:23.780397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:23.796120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:23.999836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c426665281704eb889963baae2338a12', 'request_id': 'req-3e10570e-d3c2-4b6b-be6b-4c3f07576375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:24.019322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c426665281704eb889963baae2338a12', 'request_id': 'req-3e10570e-d3c2-4b6b-be6b-4c3f07576375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:24.037153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c426665281704eb889963baae2338a12', 'request_id': 'req-3e10570e-d3c2-4b6b-be6b-4c3f07576375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:24.193412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] The token cache is being invalidate because project c426665281704eb889963baae2338a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:24.194360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:24.195993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e10570e-d3c2-4b6b-be6b-4c3f07576375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:24.201431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1011/2032] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:23 2022] DELETE /identity/v3/projects/c426665281704eb889963baae2338a12 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:24.210161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:24.212061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:24.212747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:24.360541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:24.363288 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:24.565662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1022/2033] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:24.568944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:24.569455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:24.569997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:24.617439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:24.620625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:24.649983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1012/2034] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:24.656888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:24.707597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18100828-54a9-4cc5-b1dd-40a33a7fc27f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:24.709337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:24.710092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:24.710389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:24.710676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:24.711458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:24.712305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:24.714055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:24.758166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1023/2035] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:24.763645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:24.785529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c1e0b-2f29-4a68-9c56-4a8c4a307aa1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:24.808150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:24.808846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:24.809327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:24.809875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:24.810780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:24.813065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.043964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1013/2036] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:24 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:25.049151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:25.069830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e64bf4-76ca-4f53-bfcb-9d50e3ae806c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:25.147528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:25.173825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:25.174757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.175048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.175327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.177814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:25.178444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.320054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1024/2037] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:25 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:25.330108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:25.353478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a95c8-b03b-4127-87e4-c2ea9a5e1097 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:25.364367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:25.366168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.366168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.366168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.366674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:25.368557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.381396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1014/2038] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:25.385471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:25.396225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34ef5-6bc2-4cb9-86ab-ddc59e60158c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:25.407475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:25.408081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.408372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.412785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.413595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:25.415882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2b771-a2ea-425d-a7e7-22de967414b2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.427359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1025/2039] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:25.432035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:25.446736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeeb5-da92-49a4-bfea-e38922b723bd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:25.452279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:25.453772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.454032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.454399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] PATH_INFO: `/v3/projects/354fa5b12b2946478fc174b23e92855a/users/1775d0a7fb454f7e9b43530bc838383d/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.483041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=354fa5b12b2946478fc174b23e92855a, user_id=1775d0a7fb454f7e9b43530bc838383d, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:25.487584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.660491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1015/2040] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:25 2022] PUT /identity/v3/projects/354fa5b12b2946478fc174b23e92855a/users/1775d0a7fb454f7e9b43530bc838383d/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:25.677107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c23d-a2ff-4a7a-b0d6-671d942cca3c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.677737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c23d-a2ff-4a7a-b0d6-671d942cca3c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.678369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93c23d-a2ff-4a7a-b0d6-671d942cca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.727816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8d93c23d-a2ff-4a7a-b0d6-671d942cca3c None None] MFA Rules not processed for user `1775d0a7fb454f7e9b43530bc838383d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:25.729635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8d93c23d-a2ff-4a7a-b0d6-671d942cca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:25.812141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1026/2041] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:25.827743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:25.829854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:25.908969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68a93-abb2-4a36-8b33-69a0e81612cd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:25.913215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:25.913790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:25.914110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:25.914392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:25.925632 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:25.927368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:25.939163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1016/2042] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:28.054163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed41c-87bc-4cc2-a04c-805908f2460a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:28.054882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed41c-87bc-4cc2-a04c-805908f2460a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:28.054882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed41c-87bc-4cc2-a04c-805908f2460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:28.073833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f23ed41c-87bc-4cc2-a04c-805908f2460a None None] MFA Rules not processed for user `107ed6d5d4524a29a1c545cba5e8f5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:28.076407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f23ed41c-87bc-4cc2-a04c-805908f2460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:28.135241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1027/2043] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:28.820696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:28.823425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:28.872511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:28.899769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ca6c2-43ce-4b1e-bfda-88c627c2e72b service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:28.905223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:28.906165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:28.906445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:28.906727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] PATH_INFO: `/v3/users/f316e513402f4c4aaf6b2440fd2eb84c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:28.908098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f316e513402f4c4aaf6b2440fd2eb84c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:28.910314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:29.231748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f316e513402f4c4aaf6b2440fd2eb84c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:29.246888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f316e513402f4c4aaf6b2440fd2eb84c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:29.247633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f316e513402f4c4aaf6b2440fd2eb84c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:29.255762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f316e513402f4c4aaf6b2440fd2eb84c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:29.256483 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f316e513402f4c4aaf6b2440fd2eb84c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:29.355846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1017/2044] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:28 2022] DELETE /identity/v3/users/f316e513402f4c4aaf6b2440fd2eb84c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:29.360619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:29.361126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:29.361237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:29.380924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:29.382204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:29.447663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:29.465356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1028/2045] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:29.477501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:29.479041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:29.549464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb2c4c-5f11-4b01-9e91-f1fd82f99413 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:29.555128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:29.555919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:29.556261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:29.556538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:29.566839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:29.568347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:29.579782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1018/2046] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:30.205787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:30.211823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:30.230150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a7451-6d4a-4fdc-bc63-fea7243f2b3a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:30.242599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:30.246916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:30.247980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:30.249181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] PATH_INFO: `/v3/projects/5653894a4a2146ccbdf1918dbf7f3095` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:30.254456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5653894a4a2146ccbdf1918dbf7f3095)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:30.259598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:30.492417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5653894a4a2146ccbdf1918dbf7f3095', 'request_id': 'req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:30.684146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5653894a4a2146ccbdf1918dbf7f3095', 'request_id': 'req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:30.695364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5653894a4a2146ccbdf1918dbf7f3095', 'request_id': 'req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:30.713377 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] The token cache is being invalidate because project 5653894a4a2146ccbdf1918dbf7f3095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:30.713670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:30.714388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:30.719363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1029/2047] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:30 2022] DELETE /identity/v3/projects/5653894a4a2146ccbdf1918dbf7f3095 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:30.725009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:30.745223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55b87c-168c-4a91-bf88-096e5a40b613 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:30.818548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:30.821268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:30.821268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:30.821268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] PATH_INFO: `/v3/users/422ed8dcd78445598492a671da5a3368` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:30.821268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422ed8dcd78445598492a671da5a3368)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:30.824002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:30.825819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:31.123256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422ed8dcd78445598492a671da5a3368'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:31.140479 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422ed8dcd78445598492a671da5a3368'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:31.141288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422ed8dcd78445598492a671da5a3368'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:31.150551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422ed8dcd78445598492a671da5a3368'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:31.158376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422ed8dcd78445598492a671da5a3368'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:31.301350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1019/2048] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:30 2022] DELETE /identity/v3/users/422ed8dcd78445598492a671da5a3368 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:31.985955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:31.991321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.019616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fefcd-7af2-4c2b-a7c4-669f323eef13 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:32.034172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:32.036894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.143794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:32.144772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.145134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.145488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] PATH_INFO: `/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.146886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81bb1fa65cf4b108f75bc9a7387482d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:32.149082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:32.168156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016dd83-c496-46a5-983c-c8e91d75efa5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:32.176127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:32.177664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.178226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.178751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] PATH_INFO: `/v3/users/1775d0a7fb454f7e9b43530bc838383d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.180950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1775d0a7fb454f7e9b43530bc838383d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:32.185491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:32.334894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81bb1fa65cf4b108f75bc9a7387482d', 'request_id': 'req-b012a984-2c20-4fc1-8c08-5f52fad8a11b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.429585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81bb1fa65cf4b108f75bc9a7387482d', 'request_id': 'req-b012a984-2c20-4fc1-8c08-5f52fad8a11b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.438534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81bb1fa65cf4b108f75bc9a7387482d', 'request_id': 'req-b012a984-2c20-4fc1-8c08-5f52fad8a11b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.457617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] The token cache is being invalidate because project a81bb1fa65cf4b108f75bc9a7387482d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:32.458293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.459566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.465959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1030/2049] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:31 2022] DELETE /identity/v3/projects/a81bb1fa65cf4b108f75bc9a7387482d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:32.465959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:32.466688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.484565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:32.538688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1775d0a7fb454f7e9b43530bc838383d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.565404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1775d0a7fb454f7e9b43530bc838383d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.566941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1775d0a7fb454f7e9b43530bc838383d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.571738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012a984-2c20-4fc1-8c08-5f52fad8a11b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:32.576363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:32.577259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.577537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.577817 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] PATH_INFO: `/v3/users/47358ccfac064e0fa1e86fa0ff004c75` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.579119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47358ccfac064e0fa1e86fa0ff004c75)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:32.581363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:32.582127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1775d0a7fb454f7e9b43530bc838383d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.583936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab6ffd78-edf5-4afd-adf9-e7ce5ce0855f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1775d0a7fb454f7e9b43530bc838383d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.708435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:32.719336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1020/2050] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:32 2022] DELETE /identity/v3/users/1775d0a7fb454f7e9b43530bc838383d => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:32.721712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50363-0a1b-41ec-aa9b-1b138a4ac2a7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.722129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50363-0a1b-41ec-aa9b-1b138a4ac2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.722395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50363-0a1b-41ec-aa9b-1b138a4ac2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.745938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f5f50363-0a1b-41ec-aa9b-1b138a4ac2a7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:32.747181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5f50363-0a1b-41ec-aa9b-1b138a4ac2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.816279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1021/2051] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:32.817622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b9d3-1c59-4d8a-bd5f-4c96f6af9720 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.818527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b9d3-1c59-4d8a-bd5f-4c96f6af9720 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.818527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b9d3-1c59-4d8a-bd5f-4c96f6af9720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.838276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f236b9d3-1c59-4d8a-bd5f-4c96f6af9720 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:32.839554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f236b9d3-1c59-4d8a-bd5f-4c96f6af9720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.848853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1022/2052] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:32.850986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.851442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.852142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.867600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47358ccfac064e0fa1e86fa0ff004c75'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.883162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:32.884507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.889888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47358ccfac064e0fa1e86fa0ff004c75'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.890968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47358ccfac064e0fa1e86fa0ff004c75'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.895929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1023/2053] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:32.895929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:32.895929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.905634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47358ccfac064e0fa1e86fa0ff004c75'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.911130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47358ccfac064e0fa1e86fa0ff004c75'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:32.967195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093d487-81a2-4189-a7a6-e782d4c41b3c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:32.971092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:32.971780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:32.972064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:32.972341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:32.974388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:32.988847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:32.990566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.003052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1024/2054] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:33.003895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.005438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:33.027928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427774d-df06-4961-928d-27e9c2d5782b service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.042835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.047782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.047782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.047782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.047782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:33.047782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.049596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1031/2055] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:32 2022] DELETE /identity/v3/users/47358ccfac064e0fa1e86fa0ff004c75 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:33.050477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.075281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1025/2056] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:33.083876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.209019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792d7c0-5185-459b-8d56-709da49c8d0a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.214500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.215214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.215498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.215780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.216509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.218909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.380600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.382578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:33.388535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1032/2057] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:33 2022] POST /identity/v3/projects => generated 369 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:33.392624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.405114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245516fd-68e0-4bf5-b0d0-85310bac49c7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.412113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:33.490691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4e536-89da-4d47-a5e8-a982093c65fe admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.495047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.497303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.497466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.497759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.498182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] PATH_INFO: `/v3/projects/06eea3ca15574bb49be23f075def7d30` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.498301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.498627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.498972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.499622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eea3ca15574bb49be23f075def7d30)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.499823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.501628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.501959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.522067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:33.583297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1033/2058] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:33 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:33.590217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.601363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c9ca-9070-4e4c-a61b-7ec1332ce42a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.607917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.608866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.609274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.609643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.610489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.612230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.624649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1034/2059] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:33.625650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.629714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:33.654006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe19-4381-4f8d-bdf3-d3a21057cf99 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.654006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.662920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.662920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.662920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] PATH_INFO: `/v3/projects/354fa5b12b2946478fc174b23e92855a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.662920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=354fa5b12b2946478fc174b23e92855a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.662920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:33.675567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eea3ca15574bb49be23f075def7d30', 'request_id': 'req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.683587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eea3ca15574bb49be23f075def7d30', 'request_id': 'req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.690662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eea3ca15574bb49be23f075def7d30', 'request_id': 'req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.805026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] The token cache is being invalidate because project 06eea3ca15574bb49be23f075def7d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:33.805026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.805026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.805650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1026/2060] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:33 2022] DELETE /identity/v3/projects/06eea3ca15574bb49be23f075def7d30 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:33.807252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:33.810157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:33.882165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354fa5b12b2946478fc174b23e92855a', 'request_id': 'req-46d539e4-31c2-4de3-9648-2c0553d3b17e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:33.915850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab40d-9d6c-4b9a-8205-f4698e0eda25 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:33.987435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:33.988386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:33.988768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:33.989142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:33.990163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:33.992457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.005522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1027/2061] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:34.006655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.009069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.023105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265c826-2666-47e1-bed1-e19c70ea9104 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.028881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354fa5b12b2946478fc174b23e92855a', 'request_id': 'req-46d539e4-31c2-4de3-9648-2c0553d3b17e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.032299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.032299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.032299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.032299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] PATH_INFO: `/v3/users/45baf18eb92b467891a0243832b822f2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.032889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45baf18eb92b467891a0243832b822f2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.034800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.047694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354fa5b12b2946478fc174b23e92855a', 'request_id': 'req-46d539e4-31c2-4de3-9648-2c0553d3b17e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.072882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] The token cache is being invalidate because project 354fa5b12b2946478fc174b23e92855a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:34.074009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.074588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.076596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1035/2062] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:33 2022] DELETE /identity/v3/projects/354fa5b12b2946478fc174b23e92855a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:34.077614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.079313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.097269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d539e4-31c2-4de3-9648-2c0553d3b17e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.103103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.104116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.104514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.104851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] PATH_INFO: `/v3/projects/e235df38bcd14750ba918712f7198f7b/users/251d571c0c854a33ad2c4a00a55a238c/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.131412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e235df38bcd14750ba918712f7198f7b, user_id=251d571c0c854a33ad2c4a00a55a238c, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.136153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa28175-bb28-4564-bb1b-17225d0e1dbc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.241389 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1036/2063] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:34 2022] PUT /identity/v3/projects/e235df38bcd14750ba918712f7198f7b/users/251d571c0c854a33ad2c4a00a55a238c/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:34.250286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e15a-5cd1-4b60-a5bb-e4d6ce04e271 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.250286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e15a-5cd1-4b60-a5bb-e4d6ce04e271 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.250286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e15a-5cd1-4b60-a5bb-e4d6ce04e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.297062 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0a04e15a-5cd1-4b60-a5bb-e4d6ce04e271 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:34.298728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a04e15a-5cd1-4b60-a5bb-e4d6ce04e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.342577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:34.349792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45baf18eb92b467891a0243832b822f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.375403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45baf18eb92b467891a0243832b822f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.376859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45baf18eb92b467891a0243832b822f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.386905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:34.391178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45baf18eb92b467891a0243832b822f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.392567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d3508f1-f6cb-41e6-9187-4272e7ec6b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45baf18eb92b467891a0243832b822f2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:34.416836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1037/2064] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:34.418503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.418858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.422734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.450243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] MFA Rules not processed for user `251d571c0c854a33ad2c4a00a55a238c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:34.456656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.551281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1028/2065] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:34 2022] DELETE /identity/v3/users/45baf18eb92b467891a0243832b822f2 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:34.554109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.554727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.555279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.558716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1038/2066] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:34.566718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.575594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.594328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c2c6-7fb9-45ff-9fa2-0a4ff3036506 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.601070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:34.604068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:34.723628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1029/2067] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:34.725614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.737168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.738904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b49847-088b-4539-ba48-c905e1a560f8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.742879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.743204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.744666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.746279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.753985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636c415-7649-4a91-9846-779ef90e5a62 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.757848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.761700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.763713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.764064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.764980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:34.766700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.768585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.796106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1030/2068] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:05:34.800849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.817191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e418e42-4929-48d8-9943-51db772bf733 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:34.832316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:34.833192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.833580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.834380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.834976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:34.837216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:34.932696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1039/2069] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/projects => generated 369 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:34.934177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:34.934488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:34.934745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:34.965588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1031/2070] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:34.966704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:34.984000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:34.986126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.084078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1040/2071] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:35.085824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.109362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a650c-c22a-4758-b144-1e105e62ef3e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.123265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.124487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.124997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.125980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.126814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.128852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.199174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e413-838d-4fe6-8d9d-306ca8b411fc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.210388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.211671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.212489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.213579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.216029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.219783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.294956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1032/2072] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:34 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:35.296582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.299562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.319449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aab1c-3737-4911-a17b-c4aa06fe1771 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.328786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.330363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.331031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.331890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] PATH_INFO: `/v3/projects/469a666bd69248bdab29bb491d5a213a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.333486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469a666bd69248bdab29bb491d5a213a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.336084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.349947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1041/2073] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:35.351557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.352608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.503191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1383d-31d4-41ef-9cfe-425d782fe1b3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.504795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469a666bd69248bdab29bb491d5a213a', 'request_id': 'req-ed830bd2-327a-499f-8800-a01e245f8752'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.524360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469a666bd69248bdab29bb491d5a213a', 'request_id': 'req-ed830bd2-327a-499f-8800-a01e245f8752'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.533538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469a666bd69248bdab29bb491d5a213a', 'request_id': 'req-ed830bd2-327a-499f-8800-a01e245f8752'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.632042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] The token cache is being invalidate because project 469a666bd69248bdab29bb491d5a213a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:35.644683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.644683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:35.644683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1033/2074] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:35 2022] DELETE /identity/v3/projects/469a666bd69248bdab29bb491d5a213a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:35.644683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.647830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.652316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.653774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.654463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.655145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.659415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.715925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:35.808061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830bd2-327a-499f-8800-a01e245f8752 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.815879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.823203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.823375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.823375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.823375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.823375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.823375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.824053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0eccb-7f1b-4cd6-a914-3f367bf3368e service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.830837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1034/2075] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:35.831699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.833640 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.841678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1042/2076] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:05:35.843987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.844469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.844907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.851418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07233d-e045-47bf-96b2-ab27f0e08106 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.859161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.860272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.860591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.861815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.862526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.865536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.882303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1035/2077] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:35.885709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.891754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:35.894158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:35.899866 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f0ef-b51a-45aa-afcf-5168eef44f81 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.900180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:35.909160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.911550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.912482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.912940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] PATH_INFO: `/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8/users/535a2fcebb5e4a938ec3b682147eb071/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.914503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1043/2078] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:35.916010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:35.949251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cceec1-90b3-4ba1-b392-826b4a41c09d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:35.953202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f4f3f34c7b4fb0be94ced4b30aaee8, user_id=535a2fcebb5e4a938ec3b682147eb071, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.958873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:35.960478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.965545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.965545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:35.965545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:35.966359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.966994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd6bc-dd3b-45cf-92c5-af608da34243 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:35.990697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1044/2079] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:35.993254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:35.993731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:35.994797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.028648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:36.029990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:36.043849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1045/2080] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:36.043849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.054977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f753c-bd0d-49d0-ab26-dc16c9e36a93 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.064063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.065331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.065878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.066996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] PATH_INFO: `/v3/projects/3079de9ab72b46af81439dd27d980f4f/users/fc477e421ce343e7884ca1f6cf2fbe16/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.097876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3079de9ab72b46af81439dd27d980f4f, user_id=fc477e421ce343e7884ca1f6cf2fbe16, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.102360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.145539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1036/2081] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:35 2022] PUT /identity/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8/users/535a2fcebb5e4a938ec3b682147eb071/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:36.146339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.285869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1046/2082] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:36 2022] PUT /identity/v3/projects/3079de9ab72b46af81439dd27d980f4f/users/fc477e421ce343e7884ca1f6cf2fbe16/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:36.287463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.321832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bf3f-d44d-4e32-91d1-4c5b8d3a080b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.486666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.491797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.492367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.496228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.509237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:36.513316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.513316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d724f-efaf-46ae-a7c9-b6ec0f5d9a3b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.570933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1037/2083] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:36.570933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.570933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.570933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.632335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538d63-cb24-4e2e-b921-ab7f9e421f8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.646576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] MFA Rules not processed for user `fc477e421ce343e7884ca1f6cf2fbe16`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:36.649624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:36.664599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.665777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.666772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.673381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.677855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.694446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.740410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1047/2084] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:36.741704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.859597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0c60-9264-4c0f-a509-729fcda6b2e9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.866519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.867621 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.868230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.868721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.870247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.872853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:36.902019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1038/2085] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:36.903347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:36.940169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f0406-ed00-4679-9206-dc1fed377f1a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:36.962593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:36.971289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:36.972211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:36.973092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] PATH_INFO: `/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8/users/535a2fcebb5e4a938ec3b682147eb071/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:36.979662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f4f3f34c7b4fb0be94ced4b30aaee8, user_id=535a2fcebb5e4a938ec3b682147eb071, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:36.990026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.044324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1048/2086] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:36 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:37.057977 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.060100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1039/2087] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:36 2022] PUT /identity/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8/users/535a2fcebb5e4a938ec3b682147eb071/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:37.065229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.065432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.193680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008a216-0299-43d2-93d6-c3a9c83fc4e0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.200743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.208982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.208982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.208982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.324592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419066c-0a51-42f1-8e6f-efa22290a859 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.385486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.388607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b81f1-c159-4acd-882c-bbb396fcb51f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.408311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1049/2088] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:37.410855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.411645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.412774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.444181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:37.489383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] MFA Rules not processed for user `535a2fcebb5e4a938ec3b682147eb071`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:37.491093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.565242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.565242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.568724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.569310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.571833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.580021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.593696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:37.756760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1040/2089] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/users => generated 288 bytes in 696 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:37.765886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.774346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1050/2090] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:37.810789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.822692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff328-887a-4b7f-b4c7-edcf9146d5a3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.826901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:37.849231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.852165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.852848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.854576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.856966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.860499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.895485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8299c82-4817-47e0-b14d-5b14cace89bd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:37.923650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:37.924797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:37.925223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1041/2091] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:37.925357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:37.925742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:37.929547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:37.968475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:37.972711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:37.983602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed067b-b9f8-4e63-a000-16224e78307d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.006986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.008085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.008514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.008943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.010314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.024660 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc5b4-a599-4b37-b309-bba0f3481978 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.051766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1051/2092] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:38.080167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1042/2093] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:38.080636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.127475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7662f-6ffd-4503-a898-a1fc934d8dcf service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.163260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.169683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.176290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.176951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] PATH_INFO: `/v3/projects/d52eb9e66b414d87a3ea054fc1cca3e9/users/73ed935a693746aab94f0b8814bc9f33/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.223638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52eb9e66b414d87a3ea054fc1cca3e9, user_id=73ed935a693746aab94f0b8814bc9f33, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.234656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.387014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1052/2094] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:38 2022] PUT /identity/v3/projects/d52eb9e66b414d87a3ea054fc1cca3e9/users/73ed935a693746aab94f0b8814bc9f33/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:38.423397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.423397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.423397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.450727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.510204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:38.526654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] MFA Rules not processed for user `73ed935a693746aab94f0b8814bc9f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:38.529436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.696056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a09c-2297-46ba-9c81-e992983cb6d3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.705860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.706957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.707262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.708010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.712382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.791620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1043/2095] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:38.801186 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:38.806224 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:38.947083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2868caa-7401-4c96-952a-f9902ca07385 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:38.954604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:38.955298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:38.955589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:38.955874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:38.975601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:38.980762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0427e-1556-4688-a323-d75235ac803a service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:38.997416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:39.000354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:39.015749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1053/2096] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:39.054091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1044/2097] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:39.480450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:39.711372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:42.751103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a5a7-2951-4231-a8d5-3f3e8a2017e6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:42.752373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a5a7-2951-4231-a8d5-3f3e8a2017e6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:42.752887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a5a7-2951-4231-a8d5-3f3e8a2017e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:42.820529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0624a5a7-2951-4231-a8d5-3f3e8a2017e6 None None] MFA Rules not processed for user `bbf377756836405d804d2aaba6e44c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:42.821499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0624a5a7-2951-4231-a8d5-3f3e8a2017e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:42.985972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1054/2098] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:49.010969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.035549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:49.105404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae710-9b53-47b3-a73e-bd3909cbb245 service glance] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.112449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.114112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.114543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.115379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] PATH_INFO: `/v3/users/251d571c0c854a33ad2c4a00a55a238c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.116858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251d571c0c854a33ad2c4a00a55a238c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.124577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.399225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251d571c0c854a33ad2c4a00a55a238c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.418690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251d571c0c854a33ad2c4a00a55a238c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.419554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251d571c0c854a33ad2c4a00a55a238c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.435844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251d571c0c854a33ad2c4a00a55a238c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.436948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251d571c0c854a33ad2c4a00a55a238c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:49.527366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1045/2099] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:49 2022] DELETE /identity/v3/users/251d571c0c854a33ad2c4a00a55a238c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:49.532594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.533161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.533161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.556019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:49.558068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:49.630491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1055/2100] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:49.640036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:49.641477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:49.756591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697f9d-907f-4b41-9eda-b1beeccee7f1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:49.760849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:49.764733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:49.764733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:49.764733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:49.772953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:49.774444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:49.787043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1046/2101] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:50.587474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:50.590505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:50.613637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828d33-7c57-4ae5-8e09-296885bb13fe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:50.628710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:50.629687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:50.630208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:50.630628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] PATH_INFO: `/v3/projects/e235df38bcd14750ba918712f7198f7b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:50.632242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e235df38bcd14750ba918712f7198f7b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:50.635326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:50.842478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e235df38bcd14750ba918712f7198f7b', 'request_id': 'req-453ae538-a383-4c32-b2b7-a0187899daaa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:50.961148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e235df38bcd14750ba918712f7198f7b', 'request_id': 'req-453ae538-a383-4c32-b2b7-a0187899daaa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:50.962846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:50.968184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e235df38bcd14750ba918712f7198f7b', 'request_id': 'req-453ae538-a383-4c32-b2b7-a0187899daaa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:50.981709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] The token cache is being invalidate because project e235df38bcd14750ba918712f7198f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:50.981709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:50.982076 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:50.983922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1056/2102] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:50 2022] DELETE /identity/v3/projects/e235df38bcd14750ba918712f7198f7b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:50.988019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.004047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ace62-f452-4d11-be3a-52d53ce3720b service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.087525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:51.119840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.121472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.121809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.122634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] PATH_INFO: `/v3/users/535a2fcebb5e4a938ec3b682147eb071` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.124157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=535a2fcebb5e4a938ec3b682147eb071)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.127337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:51.427134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535a2fcebb5e4a938ec3b682147eb071'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:51.450464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535a2fcebb5e4a938ec3b682147eb071'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:51.451378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535a2fcebb5e4a938ec3b682147eb071'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:51.460018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535a2fcebb5e4a938ec3b682147eb071'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:51.460788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8c2ed6d0-6b64-4280-b397-bd2f6e17b721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535a2fcebb5e4a938ec3b682147eb071'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:51.579845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1047/2103] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:50 2022] DELETE /identity/v3/users/535a2fcebb5e4a938ec3b682147eb071 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:51.679628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:51.682060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:51.706384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae538-a383-4c32-b2b7-a0187899daaa admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:51.788966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:51.788966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:51.788966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:51.788966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] PATH_INFO: `/v3/users/78ea5c908b544c9a8e138187df6e37db` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:51.789476 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ea5c908b544c9a8e138187df6e37db)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:51.789564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:52.035151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ea5c908b544c9a8e138187df6e37db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.055216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ea5c908b544c9a8e138187df6e37db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.056327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ea5c908b544c9a8e138187df6e37db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.064652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ea5c908b544c9a8e138187df6e37db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.065460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ea5c908b544c9a8e138187df6e37db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.278675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1057/2104] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:51 2022] DELETE /identity/v3/users/78ea5c908b544c9a8e138187df6e37db => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:52.284166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:52.284730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:52.284730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:52.310736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:52.312448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:52.354102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:52.364561 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:52.410288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1048/2105] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:52.413270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:52.414928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:52.525343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2420b-f318-4ca5-94d4-29fb7d8381ad None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:52.527980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435f015-1b30-423e-9ec0-6f5926c33630 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:52.532439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:52.533433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:52.533984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:52.534331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:52.545423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:52.547192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:52.547330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:52.547848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:52.548349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] PATH_INFO: `/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:52.548711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7e540-90df-4542-94d4-c291e5bf3984 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:52.550423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f4f3f34c7b4fb0be94ced4b30aaee8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:52.552739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:52.554850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:52.561314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1049/2106] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:05:52.578456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:52.724306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f4f3f34c7b4fb0be94ced4b30aaee8', 'request_id': 'req-d952ce53-0675-460a-ac89-714b3ecfafb3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.803220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f4f3f34c7b4fb0be94ced4b30aaee8', 'request_id': 'req-d952ce53-0675-460a-ac89-714b3ecfafb3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.819690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f4f3f34c7b4fb0be94ced4b30aaee8', 'request_id': 'req-d952ce53-0675-460a-ac89-714b3ecfafb3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.855172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] The token cache is being invalidate because project f9f4f3f34c7b4fb0be94ced4b30aaee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:52.855990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.857220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d952ce53-0675-460a-ac89-714b3ecfafb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:52.860205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1058/2107] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:52 2022] DELETE /identity/v3/projects/f9f4f3f34c7b4fb0be94ced4b30aaee8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:52.878604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:52.879213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:52.879845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:52.904982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:52.906650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:53.013563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1050/2108] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:53.029145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484026b-d126-4abd-a124-41de1150a2be None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.029762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484026b-d126-4abd-a124-41de1150a2be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.030338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484026b-d126-4abd-a124-41de1150a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.067502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2484026b-d126-4abd-a124-41de1150a2be None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:53.069655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2484026b-d126-4abd-a124-41de1150a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:53.084918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1059/2109] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:53.091469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.109772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a301eb5-704e-4b95-8938-d334de81e3d8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.117379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.118605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.119148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.119621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.120795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:53.121285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.123847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.139452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1051/2110] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:53.144415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484026b-d126-4abd-a124-41de1150a2be None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.156119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484026b-d126-4abd-a124-41de1150a2be None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.163618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.163618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.163618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.163618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.164334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.165576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.272046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.274468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:53.309877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4967ae-28c8-481f-8e44-0c4f1058e576 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.315424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.316672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.316672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.317124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] PATH_INFO: `/v3/projects/695d1df975824227b9c19083bbf02adf` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.318521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695d1df975824227b9c19083bbf02adf)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.321230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.355167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1060/2111] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:53 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:53.357276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.446011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3caf33-7b9c-468e-9e43-dc887405f858 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.451408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.452110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.452402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.452677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.453387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.455391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.502197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695d1df975824227b9c19083bbf02adf', 'request_id': 'req-973f1931-6930-474a-8813-867a7bdef624'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:53.512810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695d1df975824227b9c19083bbf02adf', 'request_id': 'req-973f1931-6930-474a-8813-867a7bdef624'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:53.519165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695d1df975824227b9c19083bbf02adf', 'request_id': 'req-973f1931-6930-474a-8813-867a7bdef624'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:53.559874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1061/2112] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:53 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:53.565002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.579112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3f49-5e60-4070-987a-636066a79b0f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.634857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] The token cache is being invalidate because project 695d1df975824227b9c19083bbf02adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:53.639251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:53.640521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:53.643758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1052/2113] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:53 2022] DELETE /identity/v3/projects/695d1df975824227b9c19083bbf02adf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:53.650261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.653651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:53.665640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:53.677213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.678139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.678508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.678863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.679716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.681505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.694328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1062/2114] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:53.700454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.701673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:53.716217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a39e6-0701-43bf-a64a-bdf61987aaa7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.722952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.723674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.723962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.724233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.725235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.727574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.739680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1063/2115] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:05:53.744616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:53.756545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989c84-ef6e-4f7a-a223-158ac0c270d6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.763129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.768494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.768494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.768494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] PATH_INFO: `/v3/projects/8f4a5d072e954859ba1ec4e21847970e/users/b7d750e7510445c7986c28708f924dbe/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.783085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4a5d072e954859ba1ec4e21847970e, user_id=b7d750e7510445c7986c28708f924dbe, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.786962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839ba4-50ee-4527-ae20-db247f9c1add admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.807072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1931-6930-474a-8813-867a7bdef624 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:53.816039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:53.817811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.818126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.818684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] PATH_INFO: `/v3/users/26b2fc6f8fa3488cbeb88c8808b92714` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.821021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b2fc6f8fa3488cbeb88c8808b92714)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:53.825498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:53.850569 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:53.865086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1064/2116] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:53 2022] PUT /identity/v3/projects/8f4a5d072e954859ba1ec4e21847970e/users/b7d750e7510445c7986c28708f924dbe/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:53.888714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:53.889179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:53.889754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:53.939320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] MFA Rules not processed for user `b7d750e7510445c7986c28708f924dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:53.941246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:54.053636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1065/2117] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:54.066017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:54.067573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:54.118572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b2fc6f8fa3488cbeb88c8808b92714'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.141148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b2fc6f8fa3488cbeb88c8808b92714'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.141949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b2fc6f8fa3488cbeb88c8808b92714'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.153657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b2fc6f8fa3488cbeb88c8808b92714'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.154887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b2fc6f8fa3488cbeb88c8808b92714'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.180206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d18be-ccd0-4020-8d11-b6acf87a0c39 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:54.186063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:54.187030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:54.187438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:54.187869 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:54.191040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:54.208319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:54.210044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:54.222009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1066/2118] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:54.249177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:54.251555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:54.274826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1053/2119] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:53 2022] DELETE /identity/v3/users/26b2fc6f8fa3488cbeb88c8808b92714 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:54.299834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:54.375910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabed3f-2fac-47fb-8101-011c9ae82e2d service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:54.455932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:54.457343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:54.457627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:54.457934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] PATH_INFO: `/v3/users/b7d750e7510445c7986c28708f924dbe` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:54.459282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d750e7510445c7986c28708f924dbe)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:54.461600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:54.687234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d750e7510445c7986c28708f924dbe'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.710985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d750e7510445c7986c28708f924dbe'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.712016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d750e7510445c7986c28708f924dbe'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.720736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d750e7510445c7986c28708f924dbe'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.721486 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee208c96-4830-41e8-aba7-9c8494cac77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d750e7510445c7986c28708f924dbe'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:54.822550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1067/2120] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:05:54 2022] DELETE /identity/v3/users/b7d750e7510445c7986c28708f924dbe => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:54.827105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:54.829539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:54.830680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:54.831191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:54.831873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:54.864261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ffc6-869a-4657-a9ef-658278c4f775 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:54.865071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:54.866992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:55.003472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:55.035498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.036691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.037118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.037539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] PATH_INFO: `/v3/projects/da43b57caa19481296df143e17f7e186` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.039976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da43b57caa19481296df143e17f7e186)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.042897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:55.050023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1068/2121] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:55.063014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:55.066788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:55.186260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18741c9d-98ee-4534-8cd1-0c93fa27a40d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:55.191566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.194405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.194405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.194405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.209395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.211457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78fdf3-73da-42f5-a549-e53080864d54 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:55.231901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1069/2122] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:55.242723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da43b57caa19481296df143e17f7e186', 'request_id': 'req-62506077-a3ae-47d8-b5c6-785c73a1c14a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:55.252409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da43b57caa19481296df143e17f7e186', 'request_id': 'req-62506077-a3ae-47d8-b5c6-785c73a1c14a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:55.259318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da43b57caa19481296df143e17f7e186', 'request_id': 'req-62506077-a3ae-47d8-b5c6-785c73a1c14a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:55.339900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] The token cache is being invalidate because project da43b57caa19481296df143e17f7e186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:55.340408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:55.341143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62506077-a3ae-47d8-b5c6-785c73a1c14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:55.343445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1054/2123] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:54 2022] DELETE /identity/v3/projects/da43b57caa19481296df143e17f7e186 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:55.349671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.350277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.350850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.381816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:55.384114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:55.481708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1070/2124] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:05:55.491319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.491855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.492233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.524085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:55.526345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:55.550124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1055/2125] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:55.556731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:55.573884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc01fa-6906-4827-8889-302fb5087ad2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:55.579415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.580322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.580580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.580861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.581936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:55.582277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.583993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:55.598160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1071/2126] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:55.602851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:55.615142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508ca44-fa7a-4bde-a19a-42ee14687272 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:55.621362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.622403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.622893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.623378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.624452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.626564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:55.639194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:55.771074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:55.775022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1056/2127] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:55 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:55.775868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:55.781297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:55.817195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad270f7-9f97-4abe-bee0-93c709f2d773 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:55.871947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337729d0-bdda-49ed-9af7-693abbd9fb5d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:55.877102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.878762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.878762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.878762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.879158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.881136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:55.891258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:55.892428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:55.892749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:55.893059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] PATH_INFO: `/v3/projects/8f4a5d072e954859ba1ec4e21847970e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:55.894987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4a5d072e954859ba1ec4e21847970e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:55.897749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.007843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:56.013430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1057/2128] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:55 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:56.017627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.025654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4a5d072e954859ba1ec4e21847970e', 'request_id': 'req-8038508d-4f15-4141-805f-3adc750cce76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:56.028783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4436c-4ef6-4180-a96e-e1eda9d6ecdb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.115134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.116239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.116711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.117176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.118534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.121933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.126924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4a5d072e954859ba1ec4e21847970e', 'request_id': 'req-8038508d-4f15-4141-805f-3adc750cce76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:56.137587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4a5d072e954859ba1ec4e21847970e', 'request_id': 'req-8038508d-4f15-4141-805f-3adc750cce76'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:56.137842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1058/2129] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:56.141399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.150807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] The token cache is being invalidate because project 8f4a5d072e954859ba1ec4e21847970e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:05:56.151078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:56.151773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8038508d-4f15-4141-805f-3adc750cce76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:05:56.151948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0abd94-257d-4ddf-b406-7cba3e1e8e64 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.153865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1072/2130] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:05:55 2022] DELETE /identity/v3/projects/8f4a5d072e954859ba1ec4e21847970e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:56.156608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.157274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.157558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.157835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.158398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96fda-926e-479d-91c7-732fda8b02d0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.158610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.158816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96fda-926e-479d-91c7-732fda8b02d0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.159307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96fda-926e-479d-91c7-732fda8b02d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.160208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.171119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1059/2131] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:56.175529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.177493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:56.180045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6fb96fda-926e-479d-91c7-732fda8b02d0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:56.181298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6fb96fda-926e-479d-91c7-732fda8b02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:56.191584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1073/2132] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:56.194181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0529e-525f-4383-aabe-1e90535ee232 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.200391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.200683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.200842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.201031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.201766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.202158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.202604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] PATH_INFO: `/v3/projects/36593f9a80f24281b7d3f3657a3cf7ef/users/ad59cf080069469eb9a904c6ff13b429/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.220614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36593f9a80f24281b7d3f3657a3cf7ef, user_id=ad59cf080069469eb9a904c6ff13b429, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.223509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e384-d25e-4124-b226-160026b1945b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.230791 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:56.233354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:56.251099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1074/2133] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:56.252783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.270319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780822f0-736f-44b9-96fc-26041de7d14f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.280388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.281630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.282101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.282523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.283826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:05:56.284515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.287449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.310825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1075/2134] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:05:56.317166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.330777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a70d3-3326-413b-85be-3c522c758b53 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.339113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.340127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.345665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.345665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.345665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.345665 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.365609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1060/2135] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:56 2022] PUT /identity/v3/projects/36593f9a80f24281b7d3f3657a3cf7ef/users/ad59cf080069469eb9a904c6ff13b429/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:56.378246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.378667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.379141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.414511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] MFA Rules not processed for user `ad59cf080069469eb9a904c6ff13b429`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:56.417665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:56.456528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1076/2136] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:05:56.465475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.469593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:56.527673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1061/2137] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:56.537770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.579314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e88f4-dda5-490f-9412-abb3bde6e57b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.584446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.585139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.585422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.585700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.586440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.588695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.616218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e61a-444b-45c2-9779-a5b8a3b34515 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.621211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.621931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.622210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.622488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.623192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.625142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.678207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1077/2138] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:56.682234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.695827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0720-4268-40b6-8692-b803b741656b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.702554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.703339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.703622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.703899 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.704723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.706934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.718031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1078/2139] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:56.722259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.732741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277185d-bf0e-44ff-b188-981df81be66a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.737566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.738295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.738576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.738857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.739592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.741248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.751707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1062/2140] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:56.754363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1079/2141] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:56.756207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.758655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.775811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508ae1-2965-40de-a3c7-353f80f1b42f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.827978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:56.842216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da0b8-49b1-4815-bbc8-487430619dea admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.850424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.851634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.852148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.852620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.853960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.857716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.858241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.859311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.859613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.859884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] PATH_INFO: `/v3/projects/c25911d472d44037bb948588a232848b/users/b62f03bd6c0746a2ad63147065c8f533/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.877137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25911d472d44037bb948588a232848b, user_id=b62f03bd6c0746a2ad63147065c8f533, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.879898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ac4e-798a-48a3-91fe-09d1b6dac196 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.945743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1063/2142] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:05:56.952051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:56.964854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20b482-bcaf-4e5b-a247-6b87e379b21a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:56.970665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:56.971552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.971832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.972109 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.972851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:56.974079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1080/2143] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:56 2022] PUT /identity/v3/projects/c25911d472d44037bb948588a232848b/users/b62f03bd6c0746a2ad63147065c8f533/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:05:56.974746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:56.986109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:56.986329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:56.986575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:56.990913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1064/2144] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:56.992115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:57.006782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb66424-7f90-4968-919b-7b33df6e80c4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:57.024263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] MFA Rules not processed for user `b62f03bd6c0746a2ad63147065c8f533`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:57.025819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:57.049165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:57.081392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:57.083121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.083669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.084088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] PATH_INFO: `/v3/projects/f3db09f956254262b9025ea6c53f8b91/users/324768ef7a3b43a1a7d73b920f505d77/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.101355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3db09f956254262b9025ea6c53f8b91, user_id=324768ef7a3b43a1a7d73b920f505d77, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:57.107593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:57.135439 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1081/2145] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:57.156893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:57.162795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:57.212286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1065/2146] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:56 2022] PUT /identity/v3/projects/f3db09f956254262b9025ea6c53f8b91/users/324768ef7a3b43a1a7d73b920f505d77/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:57.216450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:57.244336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e6588-6794-4274-b0ec-a437e815aa99 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:57.304780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602788f-ce73-40ec-98cc-40d6cd132a4a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:57.314543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:57.315234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.315649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.316032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.316963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:57.319504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:57.321361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:57.322926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.323859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.324239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.331924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1066/2147] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:05:57.336266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:57.350433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:05:57.352790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0959-38fe-4c89-a383-c8937547cdd2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:57.368675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:57.371587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.372211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.372692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] PATH_INFO: `/v3/projects/f3db09f956254262b9025ea6c53f8b91/users/324768ef7a3b43a1a7d73b920f505d77/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.376876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3db09f956254262b9025ea6c53f8b91, user_id=324768ef7a3b43a1a7d73b920f505d77, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:57.382194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae444782-7370-4c26-b334-de8d6bf054d7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:57.413971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1067/2148] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:05:57 2022] PUT /identity/v3/projects/f3db09f956254262b9025ea6c53f8b91/users/324768ef7a3b43a1a7d73b920f505d77/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:05:57.420138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:57.422345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:57.427151 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.427620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.428167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.437729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1082/2149] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:05:57.482035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] MFA Rules not processed for user `324768ef7a3b43a1a7d73b920f505d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:05:57.482035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:05:57.630981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1068/2150] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:05:57.644643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:05:57.655695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed7176-4cf5-4828-afef-2849d61dc0bf service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:05:57.731330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:05:57.736775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:05:57.736775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:05:57.736775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:05:57.795376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:05:57.797790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:05:57.808511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1083/2151] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:07.624941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:07.802893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=67 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:12.911350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:12.922359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26141f2-5755-409d-ac17-925bb88a0358 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:12.926562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:12.927273 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:12.927548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:12.927823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:12.938898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:12.940369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae872e-3f94-4628-b183-6b97e1a8f43c service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:12.952883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1069/2152] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:22.946371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:23.691192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:23.781670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98128a-aedb-414b-b52e-ffd09b2d5918 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:23.787077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:23.787983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:23.788286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:23.788556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] PATH_INFO: `/v3/users/b62f03bd6c0746a2ad63147065c8f533` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:23.789864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62f03bd6c0746a2ad63147065c8f533)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:23.792047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.053688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62f03bd6c0746a2ad63147065c8f533'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.066567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62f03bd6c0746a2ad63147065c8f533'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.067485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62f03bd6c0746a2ad63147065c8f533'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.076369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62f03bd6c0746a2ad63147065c8f533'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.079298 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62f03bd6c0746a2ad63147065c8f533'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.208165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1084/2153] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:23 2022] DELETE /identity/v3/users/b62f03bd6c0746a2ad63147065c8f533 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:24.212773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.213498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.213498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.239259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:24.240956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.321369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1070/2154] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:24.331944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.333761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.400273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507caf-627c-4388-bb6c-051c274da6f9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.404630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.405412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.405699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.406061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.414280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.415761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.416257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.418316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072c748-a9d5-4597-a599-a9373963cfe2 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.430179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5edce-889d-4ef5-9bf5-92c5abe1ed93 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:24.439686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:24.440705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.441057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.441436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] PATH_INFO: `/v3/users/73ed935a693746aab94f0b8814bc9f33` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.443084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ed935a693746aab94f0b8814bc9f33)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:24.444867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:24.445981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1085/2155] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:24.697453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ed935a693746aab94f0b8814bc9f33'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.714421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ed935a693746aab94f0b8814bc9f33'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.718491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ed935a693746aab94f0b8814bc9f33'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.727874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ed935a693746aab94f0b8814bc9f33'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.728821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ed935a693746aab94f0b8814bc9f33'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:24.834969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1071/2156] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:24 2022] DELETE /identity/v3/users/73ed935a693746aab94f0b8814bc9f33 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:24.839532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:24.840195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:24.840195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:24.859245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:24.861125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:24.887606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:24.954583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1086/2157] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:24.971558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:24.973150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.072712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37905cef-23e2-4af0-adf5-b046a3e2de94 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.081213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.082499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.083023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.083507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.103399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.106542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.130654 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1072/2158] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:25.389227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.389794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.443421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5201f08-278b-40c1-afa7-eb52d45af2a4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.452619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.454696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.455205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.455714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] PATH_INFO: `/v3/projects/c25911d472d44037bb948588a232848b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.458784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25911d472d44037bb948588a232848b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.462690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.604073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25911d472d44037bb948588a232848b', 'request_id': 'req-f45b22b4-8395-4b1f-9194-4ca5debdeea7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.662666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.664113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.677456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e75a6-9d88-4367-9f00-df29af8069db service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.690383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:25.735939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.736845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.737092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.737658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] PATH_INFO: `/v3/projects/d52eb9e66b414d87a3ea054fc1cca3e9` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.738611 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25911d472d44037bb948588a232848b', 'request_id': 'req-f45b22b4-8395-4b1f-9194-4ca5debdeea7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.738916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52eb9e66b414d87a3ea054fc1cca3e9)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.740839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.744970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25911d472d44037bb948588a232848b', 'request_id': 'req-f45b22b4-8395-4b1f-9194-4ca5debdeea7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.760127 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] The token cache is being invalidate because project c25911d472d44037bb948588a232848b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:25.760434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.761777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f45b22b4-8395-4b1f-9194-4ca5debdeea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.768571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1087/2159] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:25 2022] DELETE /identity/v3/projects/c25911d472d44037bb948588a232848b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:25.770739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4a68-05d5-4450-ab94-28aa233d5871 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.771064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4a68-05d5-4450-ab94-28aa233d5871 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.771346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd4a68-05d5-4450-ab94-28aa233d5871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.793177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d5dd4a68-05d5-4450-ab94-28aa233d5871 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:25.794496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5dd4a68-05d5-4450-ab94-28aa233d5871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.805641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1088/2160] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:25.814036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.814327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.814605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.833018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:25.834275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:25.843879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1089/2161] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:25.851088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.861080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b493e-504e-428d-a36b-ac586b04a9a4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.865814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.866491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.866775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.867091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.867781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:25.868089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.869683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:25.881570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1090/2162] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:06:25.885915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:25.895961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859bbc-7a77-474c-b738-ead22145dd93 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:25.908529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52eb9e66b414d87a3ea054fc1cca3e9', 'request_id': 'req-de3d15f5-4ad9-40b5-b569-1f53356b48ed'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.915545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52eb9e66b414d87a3ea054fc1cca3e9', 'request_id': 'req-de3d15f5-4ad9-40b5-b569-1f53356b48ed'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.923213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52eb9e66b414d87a3ea054fc1cca3e9', 'request_id': 'req-de3d15f5-4ad9-40b5-b569-1f53356b48ed'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:25.973187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:25.973862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:25.974188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:25.974469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:25.975174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:25.977099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.022194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] The token cache is being invalidate because project d52eb9e66b414d87a3ea054fc1cca3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:26.022482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:26.023133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-de3d15f5-4ad9-40b5-b569-1f53356b48ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:26.024729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1073/2163] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:25 2022] DELETE /identity/v3/projects/d52eb9e66b414d87a3ea054fc1cca3e9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:26.029413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c57-e50e-40f0-97c0-cfe0fdf0b2fa None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.029698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c57-e50e-40f0-97c0-cfe0fdf0b2fa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.030003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617c57-e50e-40f0-97c0-cfe0fdf0b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.057771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-59617c57-e50e-40f0-97c0-cfe0fdf0b2fa None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:26.057771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-59617c57-e50e-40f0-97c0-cfe0fdf0b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:26.065009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1074/2164] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:26.072811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.073287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.074497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.095078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:26.096290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:26.104231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1075/2165] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:26.108685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.117711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e422cb-629c-4317-bb57-fc9e86f4326b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.118987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1091/2166] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:06:25 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:26.124362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.126098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:26.132513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:26.178966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.179647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.179927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.180202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.180947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:26.181254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.183579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.197609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1076/2167] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:06:26.198649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df48e28-fa6b-4890-822b-ae19fcf0d4ea admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.202738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.206796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.207868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.208299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.208653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.209521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.212394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.215644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17047e-9b5d-44d4-97f9-82abf862555c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.224347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.230397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.230397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.230397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.230397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.231309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.327594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1092/2168] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:26.332029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.347383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436894-54fc-475d-a8bb-d8668410be3a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.353769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1077/2169] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:26.354384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.355724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.356013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.356290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.357198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.358455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.358959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.367088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:26.373733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1093/2170] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:26.380416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.394355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65af24c-929c-4ea5-b378-2e48f7d7c0af admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.442396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5cf4-2d0b-4edc-86a3-236d52d8dcbe admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.449408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.450238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.450689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.451029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.451947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.453999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.490481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.491289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.491670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.492009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.492757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.494426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.518708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1094/2171] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:26.520424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.533743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b19b9-b836-4a8b-a39b-0cf3f0d133a1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.553043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.553043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.553043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.553043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] PATH_INFO: `/v3/projects/c6200f6e9a2e4582b7998f59c2432557/users/09a42f9bd4f04176bd23a3324f6b4e8e/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.572927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6200f6e9a2e4582b7998f59c2432557, user_id=09a42f9bd4f04176bd23a3324f6b4e8e, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.579054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3d1f7-4b53-45f9-b35c-37d75b8b3d49 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.608587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1078/2172] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:26.618743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.629711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0de75-93c4-4d76-a2a4-8ecf3a764fa0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.635688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.637257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.637545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.637830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.638688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.640326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.650869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1079/2173] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:26.655480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.668405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944bdf6-d05d-4f49-95d9-4b4f5687827e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.675508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.676402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.676773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.677147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.678042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.679868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.694906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1080/2174] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:26.696624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.701680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1095/2175] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:26 2022] PUT /identity/v3/projects/c6200f6e9a2e4582b7998f59c2432557/users/09a42f9bd4f04176bd23a3324f6b4e8e/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:26.718408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.718700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.718982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.722573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efeaf-1ffc-4d98-b828-d147f0795886 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.747151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] MFA Rules not processed for user `09a42f9bd4f04176bd23a3324f6b4e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:26.748712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:26.781718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:26.787793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.787793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.787793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] PATH_INFO: `/v3/projects/efcb6f3a697d46e2b5f7db98caf2f800/users/19ec307a46f848f696512e27c6c3f8d6/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.811143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcb6f3a697d46e2b5f7db98caf2f800, user_id=19ec307a46f848f696512e27c6c3f8d6, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:26.814308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb70de6-ef8e-409e-9ce5-bb35a0087249 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:26.818537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:26.848970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1096/2176] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:26.861651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:26.865184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:26.894144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1081/2177] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:26 2022] PUT /identity/v3/projects/efcb6f3a697d46e2b5f7db98caf2f800/users/19ec307a46f848f696512e27c6c3f8d6/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:26.905981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:26.906268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:26.906563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:26.937774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8a68f-3d12-4e6b-b6fd-4e1dad8a537b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:26.938197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] MFA Rules not processed for user `19ec307a46f848f696512e27c6c3f8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:26.939451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:27.010580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:27.016962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.017925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.018226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.018502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.033362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1082/2178] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:27.038373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:27.096059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.097648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.107258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1097/2179] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:27.111387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad9c9-1322-4762-b8dc-c29e6a58c9d2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:27.120753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.120753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.120753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.120753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.121059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.121059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.300206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1083/2180] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:06:27 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:27.304605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:27.317274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbffa6-9912-4f49-9f58-88b51f3d5c01 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:27.387242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:27.394450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.395158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.395440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.395715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.396433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.398399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.529349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1098/2181] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:06:27 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:27.533394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:27.544614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4bb9-a540-44cd-859d-ae5685992494 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:27.549418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.551167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.551167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.551167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.551423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.553019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.564945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1084/2182] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:27.569416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:27.580314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbca8d-104b-43c0-bb0e-6726ad538bca admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:27.586012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.588186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.588186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.588186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.588186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.590499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2d0f2-e0a5-40c2-88e8-1129010656a5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.601882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1099/2183] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:27.606931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:27.632906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915325-5960-4e65-9384-5a3f56d56ef3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:27.639888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:27.641241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.641608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.642050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] PATH_INFO: `/v3/projects/2a93172d2e464908bba2ed20c7f18a2d/users/39f42dd779a448878593f1609062738a/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.661118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a93172d2e464908bba2ed20c7f18a2d, user_id=39f42dd779a448878593f1609062738a, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:27.663893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:27.783089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1085/2184] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:27 2022] PUT /identity/v3/projects/2a93172d2e464908bba2ed20c7f18a2d/users/39f42dd779a448878593f1609062738a/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:27.804635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:27.805053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:27.805442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:27.840080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] MFA Rules not processed for user `39f42dd779a448878593f1609062738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:27.841347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:27.947190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1100/2185] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:27.952279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.049474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6284-ed53-4fa8-8f8d-e9b6a171c395 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.057766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.059019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.059475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.059899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.061086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.064763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.181883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1086/2186] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:06:27 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:28.187011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.200993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f4241-3b63-4715-a341-195f2cdfbb4c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.280394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.281155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.281435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.281717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.282488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.284579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.399524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1101/2187] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:06:28 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:28.404292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.414983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611adc99-c51e-44e9-8ebb-2a41b3de8fd8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.420389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.421086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.421367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.421639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.422454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.424063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.435573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1087/2188] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:28.440046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.451443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199403e0-dfeb-4cdb-980e-50576dd8daf8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.456577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.457753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.458126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.458421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] PATH_INFO: `/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0/users/1e9f967b1e6d46989d666ee119f96511/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.476650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0d3d63acb44de2bbc2f1de88f7ffe0, user_id=1e9f967b1e6d46989d666ee119f96511, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.479517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.563314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1102/2189] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:28 2022] PUT /identity/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0/users/1e9f967b1e6d46989d666ee119f96511/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:28.567255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.578097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de0f02-d24a-4e82-b37b-dbf1de21f90d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.583311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:28.644793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.645486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.645780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.646091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.646833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.648424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550b8b1-7fca-45c5-ac63-1c681bc7c8be admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.659237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1088/2190] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:28.663093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.674380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235e9c-40e7-44dc-b00c-1955b6bbe894 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.679117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.680013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.680293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.680570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] PATH_INFO: `/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0/users/1e9f967b1e6d46989d666ee119f96511/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.682570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0d3d63acb44de2bbc2f1de88f7ffe0, user_id=1e9f967b1e6d46989d666ee119f96511, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.685838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.696649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1103/2191] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:28 2022] PUT /identity/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0/users/1e9f967b1e6d46989d666ee119f96511/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:28.706909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.707202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.707733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.735484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] MFA Rules not processed for user `1e9f967b1e6d46989d666ee119f96511`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:28.736691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:28.809320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1089/2192] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:28.826157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:28.849613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:28.901416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f115-5685-44b4-af20-802d0fed2933 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:28.912581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:28.912581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:28.912581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:28.912581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:28.981459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:28.983057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10864150-677f-4ff6-bee0-6ba482e39f18 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:28.993638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1104/2193] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:31.101731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:31.105338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:31.205108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:31.205737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:31.206053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:31.225275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] MFA Rules not processed for user `09a42f9bd4f04176bd23a3324f6b4e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:31.226920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:31.274601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878dd75-f3b3-4311-abc7-90d6dac5500e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:31.283913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:31.285043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:31.285620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:31.286301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:31.289313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:31.311033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:31.313072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:31.313677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1105/2194] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:31.321391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:31.328630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1090/2195] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:32.388126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:32.391260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:32.421644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f91b-1f0a-4c6c-b48f-cf59ef15b86f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:32.428651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:32.431282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:32.431676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:32.432052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:32.581154 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:32.591673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:32.619533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1106/2196] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:34.699120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:34.708952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70dbb-6685-47a3-83af-d1a383a48e36 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:34.712626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:34.713282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:34.713566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:34.713843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:34.723696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:34.725132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e467-4cb5-4778-baab-b125261b556f service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:34.737766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1091/2197] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:42.612563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:44.740160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:53.206148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:53.276792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13187-fac8-4f18-a746-f549a0905340 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:53.282268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:53.283262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:53.283608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:53.283884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] PATH_INFO: `/v3/users/19ec307a46f848f696512e27c6c3f8d6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:53.285240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ec307a46f848f696512e27c6c3f8d6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:53.287604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:53.494013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ec307a46f848f696512e27c6c3f8d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:53.511795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ec307a46f848f696512e27c6c3f8d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:53.512555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ec307a46f848f696512e27c6c3f8d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:53.520014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ec307a46f848f696512e27c6c3f8d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:53.521046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ec307a46f848f696512e27c6c3f8d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:53.639009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1107/2198] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:53 2022] DELETE /identity/v3/users/19ec307a46f848f696512e27c6c3f8d6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:53.646325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:53.657604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:53.657604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:53.671250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:53.672576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:53.745757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1092/2199] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:53.756254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:53.757702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:53.851719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685ef49-1996-4ebf-8f92-b604c205b91f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:53.855319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:53.856031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:53.856309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:53.856583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:53.867565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:53.869418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:53.881285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1108/2200] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:06:54.483476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:54.484959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:54.499744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a7e0-d129-41b1-8c54-fcc12e4c982e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:54.506108 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:54.510627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:54.510627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:54.510627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] PATH_INFO: `/v3/projects/efcb6f3a697d46e2b5f7db98caf2f800` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:54.510627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcb6f3a697d46e2b5f7db98caf2f800)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:54.513211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:54.662534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcb6f3a697d46e2b5f7db98caf2f800', 'request_id': 'req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:54.671213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcb6f3a697d46e2b5f7db98caf2f800', 'request_id': 'req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:54.677609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcb6f3a697d46e2b5f7db98caf2f800', 'request_id': 'req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:54.801919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] The token cache is being invalidate because project efcb6f3a697d46e2b5f7db98caf2f800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:54.802211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:54.802918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:54.804535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1093/2201] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:54 2022] DELETE /identity/v3/projects/efcb6f3a697d46e2b5f7db98caf2f800 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:54.810358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:54.820698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f88ba-bb63-4314-9706-265cf7c380f9 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:54.843386 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:54.888684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:54.889607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:54.889925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:54.890217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] PATH_INFO: `/v3/users/39f42dd779a448878593f1609062738a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:54.891649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f42dd779a448878593f1609062738a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:54.893600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:55.210923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f42dd779a448878593f1609062738a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:55.225593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f42dd779a448878593f1609062738a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:55.226424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f42dd779a448878593f1609062738a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:55.235385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f42dd779a448878593f1609062738a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:55.236151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f42dd779a448878593f1609062738a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:55.349240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1109/2202] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:54 2022] DELETE /identity/v3/users/39f42dd779a448878593f1609062738a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:55.992772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:55.994501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:56.009492 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8b24-4a5f-4b50-ab98-57761a2ad5d7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:56.069814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:56.070727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:56.071025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:56.071288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] PATH_INFO: `/v3/projects/2a93172d2e464908bba2ed20c7f18a2d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:56.072507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a93172d2e464908bba2ed20c7f18a2d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:56.074502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:56.220712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:56.241858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a93172d2e464908bba2ed20c7f18a2d', 'request_id': 'req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.249772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a93172d2e464908bba2ed20c7f18a2d', 'request_id': 'req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.258366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a93172d2e464908bba2ed20c7f18a2d', 'request_id': 'req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.356745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] The token cache is being invalidate because project 2a93172d2e464908bba2ed20c7f18a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:56.359476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.359476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.359476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1094/2203] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:55 2022] DELETE /identity/v3/projects/2a93172d2e464908bba2ed20c7f18a2d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:56.363592 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:56.365107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:56.378942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6e343-ee76-4d0f-8a2f-e2332b381eda admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:56.453228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:56.454559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:56.454936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:56.455300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] PATH_INFO: `/v3/users/1e9f967b1e6d46989d666ee119f96511` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:56.456709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9f967b1e6d46989d666ee119f96511)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:56.459296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:56.671276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:56.674015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9f967b1e6d46989d666ee119f96511'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.688711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9f967b1e6d46989d666ee119f96511'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.689602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9f967b1e6d46989d666ee119f96511'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.697500 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9f967b1e6d46989d666ee119f96511'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.698268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83a66b07-1220-42a5-9bb6-4d73f9150302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9f967b1e6d46989d666ee119f96511'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:56.788174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1110/2204] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:56 2022] DELETE /identity/v3/users/1e9f967b1e6d46989d666ee119f96511 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:56.802594 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:56.804124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:56.819198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e87ba8-d0f2-427c-846b-779e0bc9ebca admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:56.936261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:56.937434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:56.937639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:56.937870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] PATH_INFO: `/v3/users/ad59cf080069469eb9a904c6ff13b429` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:56.939317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad59cf080069469eb9a904c6ff13b429)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:56.941271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:57.186113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad59cf080069469eb9a904c6ff13b429'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.207558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad59cf080069469eb9a904c6ff13b429'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.209035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad59cf080069469eb9a904c6ff13b429'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.219341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad59cf080069469eb9a904c6ff13b429'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.220202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad59cf080069469eb9a904c6ff13b429'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.359452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1095/2205] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:56 2022] DELETE /identity/v3/users/ad59cf080069469eb9a904c6ff13b429 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:57.364540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.365085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.365176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.397134 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:57.399039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.404004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:57.406254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.441718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:57.487892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc548438-cb0e-442d-a3f8-539b997b1eeb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:57.494087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:57.496016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.497543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.498185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] PATH_INFO: `/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.504246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0d3d63acb44de2bbc2f1de88f7ffe0)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:57.506879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:57.569648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1111/2206] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:06:57.580916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:57.583307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.667112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538793a7-02a0-423d-aa9c-0c43b2ddfd2b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:57.678860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0d3d63acb44de2bbc2f1de88f7ffe0', 'request_id': 'req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.694431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0d3d63acb44de2bbc2f1de88f7ffe0', 'request_id': 'req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.704370 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0d3d63acb44de2bbc2f1de88f7ffe0', 'request_id': 'req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.737005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:57.737755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.738200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.738585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.786029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:57.791239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] The token cache is being invalidate because project cd0d3d63acb44de2bbc2f1de88f7ffe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:57.791606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.792480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51e495cc-d51e-4d8c-ae6f-99fc7cf8f768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:57.794931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1096/2207] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:57 2022] DELETE /identity/v3/projects/cd0d3d63acb44de2bbc2f1de88f7ffe0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:57.800017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da5ca-fbcb-4e0d-9298-1011e4fd9dfe None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.800546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da5ca-fbcb-4e0d-9298-1011e4fd9dfe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.801772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da5ca-fbcb-4e0d-9298-1011e4fd9dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.829819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b64da5ca-fbcb-4e0d-9298-1011e4fd9dfe None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:57.831384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b64da5ca-fbcb-4e0d-9298-1011e4fd9dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.836667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:57.838805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:57.840421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1097/2208] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:57.850254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.850561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.850885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.855483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1112/2209] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:57.873625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:57.875084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.889806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1098/2210] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:57.892384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:57.893221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:57.907834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a30-2481-4cbd-a891-21269d56ffe4 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:57.913091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:57.913983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.914409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.914784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.915758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:06:57.916015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:57.917696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:57.932764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1113/2211] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:06:57.939234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:57.950065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744fc64-c78b-45c1-9337-54caeb2cffa0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:57.956748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:57.957498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:57.958138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:57.958300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:57.959011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:57.960966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.072201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1099/2212] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:06:57 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:06:58.078098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.090336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46cd6-0ded-46c2-bde2-fe5c1fb137da admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.162249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.163321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.163780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.164057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.164769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.167258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.271000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1114/2213] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:06:58 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:06:58.275829 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.290985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabee1b-34e9-476a-8ba1-6556aaab82ce admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.297187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.297914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.298205 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.301376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.301376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.301376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.312700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1100/2214] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:06:58.316759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.327683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabafe0-3cbb-4181-847d-b5904a97b94c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.332773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.333245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.333539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.333819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.334591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.336184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.347512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1115/2215] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:06:58.351819 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.363388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7601ff-8bb0-49d3-ae98-5ceed91a73cc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.365119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.367044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.369747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.370820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.370971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.371248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] PATH_INFO: `/v3/projects/f722e284eda84b078c1c6935fb728f82/users/757f0e0a07754669b7cb9f21502e5906/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.381163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6438-d393-488e-8379-c21dc2e5c8a5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.386532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.387972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.389721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.389721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] PATH_INFO: `/v3/projects/36593f9a80f24281b7d3f3657a3cf7ef` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.390397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36593f9a80f24281b7d3f3657a3cf7ef)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.392691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.398928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f722e284eda84b078c1c6935fb728f82, user_id=757f0e0a07754669b7cb9f21502e5906, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.402467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fde5e7-19d8-48ba-80d2-79eaf8285b92 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.539669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1101/2216] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:06:58 2022] PUT /identity/v3/projects/f722e284eda84b078c1c6935fb728f82/users/757f0e0a07754669b7cb9f21502e5906/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:06:58.544538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.544828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.545130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.554939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36593f9a80f24281b7d3f3657a3cf7ef', 'request_id': 'req-6578e58f-789b-4116-bbdd-e8027bdc78f0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.561867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:06:58.563100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.610154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:58.623453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1102/2217] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:06:58.632872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.634262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.647401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36593f9a80f24281b7d3f3657a3cf7ef', 'request_id': 'req-6578e58f-789b-4116-bbdd-e8027bdc78f0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.654238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36593f9a80f24281b7d3f3657a3cf7ef', 'request_id': 'req-6578e58f-789b-4116-bbdd-e8027bdc78f0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.666662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] The token cache is being invalidate because project 36593f9a80f24281b7d3f3657a3cf7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:06:58.666952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.667624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.670129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1116/2218] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:58 2022] DELETE /identity/v3/projects/36593f9a80f24281b7d3f3657a3cf7ef => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:58.674231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:58.675726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.689940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578e58f-789b-4116-bbdd-e8027bdc78f0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.694923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.695806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.696090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.696370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] PATH_INFO: `/v3/users/324768ef7a3b43a1a7d73b920f505d77` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.697993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324768ef7a3b43a1a7d73b920f505d77)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.700963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.707630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3e77-8f11-4d09-a6b4-6b4cb15c617e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:58.711314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:58.712260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:58.712731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:58.713096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:58.715580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:06:58.729133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:58.730643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:06:58.741419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1103/2219] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:06:58.830692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:06:58.914944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324768ef7a3b43a1a7d73b920f505d77'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.929986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324768ef7a3b43a1a7d73b920f505d77'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.930749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324768ef7a3b43a1a7d73b920f505d77'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.938731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324768ef7a3b43a1a7d73b920f505d77'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:58.939612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a1e21f8a-44e6-4b7f-9214-8b7798894714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324768ef7a3b43a1a7d73b920f505d77'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:06:59.046932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1117/2220] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:06:58 2022] DELETE /identity/v3/users/324768ef7a3b43a1a7d73b920f505d77 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:06:59.773153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:06:59.786128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf9a2c-1b3d-4c94-b37c-8ba881c6ea7f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:06:59.882935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:06:59.883830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:06:59.884162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:06:59.884445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] PATH_INFO: `/v3/projects/f3db09f956254262b9025ea6c53f8b91` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:06:59.886006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3db09f956254262b9025ea6c53f8b91)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:06:59.887882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.038480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3db09f956254262b9025ea6c53f8b91', 'request_id': 'req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:00.046620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3db09f956254262b9025ea6c53f8b91', 'request_id': 'req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:00.053926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3db09f956254262b9025ea6c53f8b91', 'request_id': 'req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:00.191237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] The token cache is being invalidate because project f3db09f956254262b9025ea6c53f8b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:00.191525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:00.192190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fa35a7a8-cdda-47a4-95c4-1fd46b79188c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:00.193785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1104/2221] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:06:59 2022] DELETE /identity/v3/projects/f3db09f956254262b9025ea6c53f8b91 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:00.200735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.201273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.201367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.222414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:00.223932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:00.292868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1118/2222] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:00.300743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.301029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.301304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.323887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:00.326332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:00.334846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1105/2223] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:00.339316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.349593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12468f7-f8fe-4ebf-8e0b-b4bb260b62fa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.354382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.355048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.356087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.356087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.356511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:00.356821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.358878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10009b-6176-46a7-80f1-c8f549015802 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.376413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1119/2224] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:00.377953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.388563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822c2fb-156b-445b-92a0-1f9ead395f55 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.393558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.394360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.394647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.394924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.395631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.397571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.435854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.436152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.436443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.467039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] MFA Rules not processed for user `757f0e0a07754669b7cb9f21502e5906`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:00.468289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:00.518502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:00.528452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1106/2225] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:00 2022] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:00.532254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.545818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1120/2226] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:00.557843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.559867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:00.567181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:00.617211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a74724-38d8-4af8-9a54-882363a00eb7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.625289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.627629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.629537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.630473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.632013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.633055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ee7c-fb21-42f4-bd48-6f5df1ddf26f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.637298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.696257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.696927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.697210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.697515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.765070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.766724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.776608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1121/2227] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:00.799561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1107/2228] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:00 2022] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:00.800336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.813540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c831d7-df76-4b2d-9d3f-61e790c22f2c service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.818653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.819726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.819726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.820168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.820671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.822683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.837997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1122/2229] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:00.839285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.853357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48760e-05c1-4edf-853b-6efbdab47378 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.858989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.864258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.864258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.864258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.864258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.864258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ede67-2731-4a8f-a03a-2832d7622776 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:00.877019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1108/2230] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:00.878317 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:00.901339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a48c91-6627-4244-a1f8-104eab0a1c65 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:00.917113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:00.918162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:00.918986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:00.920000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] PATH_INFO: `/v3/projects/8c7cedbdf63c4667bd47433245af4280/users/73da72d6ffbf4a1b88d9a24abb2ada68/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:00.948738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7cedbdf63c4667bd47433245af4280, user_id=73da72d6ffbf4a1b88d9a24abb2ada68, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:00.952355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.067730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1123/2231] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:00 2022] PUT /identity/v3/projects/8c7cedbdf63c4667bd47433245af4280/users/73da72d6ffbf4a1b88d9a24abb2ada68/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:01.079505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.079844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.080163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.110988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] MFA Rules not processed for user `73da72d6ffbf4a1b88d9a24abb2ada68`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:01.112274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:01.184787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1109/2232] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:01.189519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.259103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591985bc-1a90-4753-aecd-854b925ecf94 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.266572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.267691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.268187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.268640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.269938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.273537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.413157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1124/2233] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:01 2022] POST /identity/v3/projects => generated 409 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:01.415522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.426870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef15316-2f70-4799-aa49-2088f278e9d4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.490193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.490876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.491160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.491436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.492302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.494149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.604762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1110/2234] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:01 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:01.610216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.624355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec052-838c-45fd-8028-c371596d80f0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.637808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.638667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.638960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.639236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.640218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.641975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.660257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1125/2235] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:01.664899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.675786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df1320-13f8-45e0-8d8b-2d9ab7645a56 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.680421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.681315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.681591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.681864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] PATH_INFO: `/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04/users/22b85bd965654b59a1ae21ceac9715de/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.698269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030d6ba22e5c4825bb2f1d6c9179be04, user_id=22b85bd965654b59a1ae21ceac9715de, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.704351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.785493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1111/2236] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:01 2022] PUT /identity/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04/users/22b85bd965654b59a1ae21ceac9715de/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:01.789580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.800840 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063a6f6-e86b-4542-a3e7-0cec197f1356 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.865056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.865737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.866077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.866344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.867085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.868713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2292-b20e-411c-83c3-c1b594f63303 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.879804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1126/2237] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:01.884236 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:01.891888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:01.897196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a3c7-a3a4-4841-ad82-53a5f3a8619d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:01.902367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:01.903911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.904194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.904529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] PATH_INFO: `/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04/users/22b85bd965654b59a1ae21ceac9715de/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.906600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=030d6ba22e5c4825bb2f1d6c9179be04, user_id=22b85bd965654b59a1ae21ceac9715de, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:01.909317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:01.922405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1112/2238] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:01 2022] PUT /identity/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04/users/22b85bd965654b59a1ae21ceac9715de/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:01.932870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:01.933160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:01.933444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:01.962705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] MFA Rules not processed for user `22b85bd965654b59a1ae21ceac9715de`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:01.963985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:01.985963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:02.038214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1127/2239] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:02.050434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:02.109251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89708b37-af71-4fe3-8aac-e94b0b1cfa6c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:02.113035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:02.113692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:02.114004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:02.114283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:02.124668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:02.126152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f987358-b9f2-4b22-8d6b-7ae38ef11186 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:02.136374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1113/2240] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:02.703563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:02.705198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:02.718859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cc176-0fad-407b-a721-4eca15cbfa7a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:02.728498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:02.729674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:02.730262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:02.730771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:02.827843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:02.830417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:02.841391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1128/2241] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:03.019746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:03.891718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffc7d8-2705-458d-ac4e-45daad7a8b58 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:03.892306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffc7d8-2705-458d-ac4e-45daad7a8b58 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:03.892306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffc7d8-2705-458d-ac4e-45daad7a8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:03.915900 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-61ffc7d8-2705-458d-ac4e-45daad7a8b58 None None] MFA Rules not processed for user `757f0e0a07754669b7cb9f21502e5906`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:03.916969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-61ffc7d8-2705-458d-ac4e-45daad7a8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:04.027249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1114/2242] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:04.596426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:04.601537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:04.671712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9340-2b02-407e-b92b-4fcba2ae83c5 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:04.675874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:04.676966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:04.677458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:04.677802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:04.679886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:04.750050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:04.751403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:04.761357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1129/2243] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:06.520447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc50b-55e6-4c71-b00d-2aa6291d41f4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:06.521016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc50b-55e6-4c71-b00d-2aa6291d41f4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:06.521016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc50b-55e6-4c71-b00d-2aa6291d41f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:06.597832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-654bc50b-55e6-4c71-b00d-2aa6291d41f4 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:06.599322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-654bc50b-55e6-4c71-b00d-2aa6291d41f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:06.660902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:06.698222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1115/2244] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:06.748458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:06.750153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:06.867727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493d62b-bc68-4f91-b77e-aa9f47cffcc9 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:06.873198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:06.873872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:06.874184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:06.874468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:06.880348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:06.884315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:06.886208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:06.896367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1130/2245] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:07:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:07:08.167977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610cbb-64e4-4d9d-b58a-45e23a30c957 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:08.169122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610cbb-64e4-4d9d-b58a-45e23a30c957 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:08.169470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d610cbb-64e4-4d9d-b58a-45e23a30c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:08.216485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1d610cbb-64e4-4d9d-b58a-45e23a30c957 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:08.221431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1d610cbb-64e4-4d9d-b58a-45e23a30c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:08.244898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1116/2246] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:08.267162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:08.288012 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e55cf9-4d8c-4a87-86d9-4a8a913744f9 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:08.293877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:08.294681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:08.295158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:08.295446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:08.305242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:08.306897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:08.318029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1131/2247] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:07:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:07:09.094901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9e4d-4beb-4e09-9b68-0b81d0996c8e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.094901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9e4d-4beb-4e09-9b68-0b81d0996c8e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.094901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9e4d-4beb-4e09-9b68-0b81d0996c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.114924 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-da8d9e4d-4beb-4e09-9b68-0b81d0996c8e None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:09.116176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-da8d9e4d-4beb-4e09-9b68-0b81d0996c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.123889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1117/2248] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:09.137729 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.149312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52682d-b399-454b-9a10-bfb03ffb3df9 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.155278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.155933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.156283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.156577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.166948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.168697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.178271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1132/2249] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:07:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:07:09.862397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.862876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.862876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.882350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:09.883607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:09.891554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1118/2250] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:09.907309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:09.918404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd241d8-f336-44c3-8840-5cd7b865b113 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:09.923907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:09.924590 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:09.924873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:09.925151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:09.934480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:09.936096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:09.945087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1133/2251] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:07:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 21:07:15.017271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.018872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.096813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.098448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.135590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64157d63-3d0d-4ba6-82f2-f48ebb3b7d55 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.142584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.144361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.144705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.145004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] PATH_INFO: `/v3/users/fc477e421ce343e7884ca1f6cf2fbe16` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.146474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc477e421ce343e7884ca1f6cf2fbe16)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.148659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:15.200842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e7c2-047a-4795-b59c-76ad0732ac1c service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.206721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.207639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.207923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.208474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] PATH_INFO: `/v3/users/09a42f9bd4f04176bd23a3324f6b4e8e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.210575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a42f9bd4f04176bd23a3324f6b4e8e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.212762 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:15.430983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a42f9bd4f04176bd23a3324f6b4e8e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.449374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a42f9bd4f04176bd23a3324f6b4e8e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.450927 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a42f9bd4f04176bd23a3324f6b4e8e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.472022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a42f9bd4f04176bd23a3324f6b4e8e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.473348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc477e421ce343e7884ca1f6cf2fbe16'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.474028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-384b33ea-57b5-422a-83c7-c040c8512858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a42f9bd4f04176bd23a3324f6b4e8e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.508305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc477e421ce343e7884ca1f6cf2fbe16'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.509373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc477e421ce343e7884ca1f6cf2fbe16'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.522902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc477e421ce343e7884ca1f6cf2fbe16'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.523908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-32475049-c933-4bb9-9a83-2493e72fff76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc477e421ce343e7884ca1f6cf2fbe16'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:15.656908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1134/2252] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:15 2022] DELETE /identity/v3/users/09a42f9bd4f04176bd23a3324f6b4e8e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:15.658915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.659206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.659541 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.679250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:15.680491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.724842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:15.756949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1135/2253] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:15.766300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.767852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.768302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1119/2254] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:15 2022] DELETE /identity/v3/users/fc477e421ce343e7884ca1f6cf2fbe16 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:15.773346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.774554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.775068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.806063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:15.807394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.839393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:15.863796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dec0-f5c5-4046-b780-eefa950935c4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.881094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1120/2255] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:15.891867 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:15.893545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:15.920696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.921824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.921824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.922222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.932730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.934814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:15.946186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1136/2256] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:15.970216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9f37d-2916-4cc5-8fb7-529d2976c8ba None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:15.976458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:15.977288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:15.977645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:15.978166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:15.990164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:15.991759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.003055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1121/2257] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:16.325534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:16.327383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.347616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a88d-77cd-4dc7-9e78-21df8b606fb6 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:16.354629 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:16.355842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.356830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.357489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] PATH_INFO: `/v3/projects/c6200f6e9a2e4582b7998f59c2432557` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.362475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6200f6e9a2e4582b7998f59c2432557)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:16.362731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.549275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6200f6e9a2e4582b7998f59c2432557', 'request_id': 'req-e13ef7dd-de13-4483-8bbd-f3eb077166f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.593228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:16.594934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.618945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aee3c-bc76-44ec-ab0c-0c69d405968f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:16.636669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6200f6e9a2e4582b7998f59c2432557', 'request_id': 'req-e13ef7dd-de13-4483-8bbd-f3eb077166f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.651687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6200f6e9a2e4582b7998f59c2432557', 'request_id': 'req-e13ef7dd-de13-4483-8bbd-f3eb077166f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.675563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] The token cache is being invalidate because project c6200f6e9a2e4582b7998f59c2432557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:16.676120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.677060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.679759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1137/2258] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:16 2022] DELETE /identity/v3/projects/c6200f6e9a2e4582b7998f59c2432557 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:16.680920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:16.682725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:16.719319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:16.720367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.720712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.720950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] PATH_INFO: `/v3/users/73da72d6ffbf4a1b88d9a24abb2ada68` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.722386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=73da72d6ffbf4a1b88d9a24abb2ada68)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:16.724885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.821765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ef7dd-de13-4483-8bbd-f3eb077166f7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:16.827412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:16.828430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:16.828746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:16.829126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] PATH_INFO: `/v3/projects/3079de9ab72b46af81439dd27d980f4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:16.830645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3079de9ab72b46af81439dd27d980f4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:16.832754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:16.988837 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73da72d6ffbf4a1b88d9a24abb2ada68'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:16.990854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3079de9ab72b46af81439dd27d980f4f', 'request_id': 'req-ff483492-97be-47b2-b6ae-2ee4d970202b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.004965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73da72d6ffbf4a1b88d9a24abb2ada68'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.007546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73da72d6ffbf4a1b88d9a24abb2ada68'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.018487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73da72d6ffbf4a1b88d9a24abb2ada68'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.019247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-aed4ed48-a48f-4cba-94e7-7621dc2e32cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73da72d6ffbf4a1b88d9a24abb2ada68'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.185466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3079de9ab72b46af81439dd27d980f4f', 'request_id': 'req-ff483492-97be-47b2-b6ae-2ee4d970202b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.191808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3079de9ab72b46af81439dd27d980f4f', 'request_id': 'req-ff483492-97be-47b2-b6ae-2ee4d970202b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.203466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] The token cache is being invalidate because project 3079de9ab72b46af81439dd27d980f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:17.203749 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.204495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ff483492-97be-47b2-b6ae-2ee4d970202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:17.206467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1138/2259] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:16 2022] DELETE /identity/v3/projects/3079de9ab72b46af81439dd27d980f4f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:17.211344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2532-bad5-4c02-b9d7-51b3f1b2212f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.211658 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2532-bad5-4c02-b9d7-51b3f1b2212f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.211964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2532-bad5-4c02-b9d7-51b3f1b2212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.233550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-909f2532-bad5-4c02-b9d7-51b3f1b2212f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:17.235144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-909f2532-bad5-4c02-b9d7-51b3f1b2212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.262518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1122/2260] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:16 2022] DELETE /identity/v3/users/73da72d6ffbf4a1b88d9a24abb2ada68 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:17.270283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.273778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.274403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.299895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:17.301507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.328674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1139/2261] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:17.342550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.343496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.343960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.373651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:17.375570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.397163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1123/2262] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:17.415221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.416624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:17.459781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1140/2263] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:17.464254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.475113 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a310a-ffa6-42ed-8070-d828fdca1d01 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.480296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.481035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.481324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.481603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.482416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:17.482731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.484402 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.488194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2399446-4107-4f12-87ec-9b54bc6db1d5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.492914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.493847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.494230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.499016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.509495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1141/2264] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:17.510208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.511238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.514291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.529135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6edd4-90b6-4657-9331-cc4574ff09bd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.532034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1124/2265] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:07:17.536712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:17.539069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.539069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.539069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.539498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.540371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.542509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.713153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1142/2266] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:17.718332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.729771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947abff0-3436-4f1f-99ed-5723dd1b9f50 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.822289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:17.831506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.832442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.832733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.833007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.834082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.836342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.932572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1125/2267] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:17 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:17.937808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.948891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e856-6f55-4669-962e-b15ee89f46af admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.954809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.955550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.955837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.956112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.956861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.958822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:17.971884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1143/2268] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:17.975247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:17.987929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71e43-a813-48ed-ab44-279b348f2cb2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:17.993467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:17.994316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:17.994623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:17.994884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:17.995635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:17.997865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.009931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1126/2269] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:18.014823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.025679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07afbd4-3139-462c-82de-83cc138c7d24 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.031272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.032190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.032470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.032772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] PATH_INFO: `/v3/projects/4271cc6629ca4c36b7d741295979866b/users/0133cf5666e944baa3399ff8ed76279b/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.049624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4271cc6629ca4c36b7d741295979866b, user_id=0133cf5666e944baa3399ff8ed76279b, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.052522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecebb2-428b-4516-b02f-9100e27c32d0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.132278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.132981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1144/2270] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:18 2022] PUT /identity/v3/projects/4271cc6629ca4c36b7d741295979866b/users/0133cf5666e944baa3399ff8ed76279b/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:18.134772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.145028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.145435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.145916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.158197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8887-b6d8-4fb2-88c8-4affe1dfed73 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.176627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] MFA Rules not processed for user `0133cf5666e944baa3399ff8ed76279b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:18.178290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.227922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.229075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.229572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.229945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] PATH_INFO: `/v3/projects/8c7cedbdf63c4667bd47433245af4280` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.231978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7cedbdf63c4667bd47433245af4280)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.234062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.256654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1145/2271] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:18.269104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.270939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:18.334554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61c303-762d-4106-9f4f-9840ce9096fa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.338944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.339622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.339910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.340953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.349843 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.351356 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.361601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1146/2272] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:18.448947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7cedbdf63c4667bd47433245af4280', 'request_id': 'req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.461921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7cedbdf63c4667bd47433245af4280', 'request_id': 'req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.471787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7cedbdf63c4667bd47433245af4280', 'request_id': 'req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.574408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] The token cache is being invalidate because project 8c7cedbdf63c4667bd47433245af4280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:18.575361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.576235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.578174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1127/2273] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:18 2022] DELETE /identity/v3/projects/8c7cedbdf63c4667bd47433245af4280 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:18.583578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:18.597292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a30f0-f979-447a-aee0-af21f0f8ee76 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:18.682717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:18.683688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:18.684583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:18.684886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] PATH_INFO: `/v3/users/22b85bd965654b59a1ae21ceac9715de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:18.686290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b85bd965654b59a1ae21ceac9715de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:18.688296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:18.928056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b85bd965654b59a1ae21ceac9715de'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.945849 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b85bd965654b59a1ae21ceac9715de'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.946750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b85bd965654b59a1ae21ceac9715de'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.955972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b85bd965654b59a1ae21ceac9715de'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:18.956712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5897f4c0-92fe-42bf-81a0-3320b9934894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b85bd965654b59a1ae21ceac9715de'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:19.055578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1147/2274] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:18 2022] DELETE /identity/v3/users/22b85bd965654b59a1ae21ceac9715de => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:19.477019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:19.743354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:19.747972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:19.776287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a0e4e-8c57-482e-8786-b2231f9e4ad8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:19.858536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:19.858536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:19.859007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:19.859007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] PATH_INFO: `/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:19.860379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=030d6ba22e5c4825bb2f1d6c9179be04)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:19.862601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:19.928119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:20.024227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030d6ba22e5c4825bb2f1d6c9179be04', 'request_id': 'req-f9de4c90-c423-45a5-8797-4488594fd7fc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.033788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030d6ba22e5c4825bb2f1d6c9179be04', 'request_id': 'req-f9de4c90-c423-45a5-8797-4488594fd7fc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.041765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030d6ba22e5c4825bb2f1d6c9179be04', 'request_id': 'req-f9de4c90-c423-45a5-8797-4488594fd7fc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.160928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] The token cache is being invalidate because project 030d6ba22e5c4825bb2f1d6c9179be04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:20.161612 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.162684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f9de4c90-c423-45a5-8797-4488594fd7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:20.164756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1128/2275] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:19 2022] DELETE /identity/v3/projects/030d6ba22e5c4825bb2f1d6c9179be04 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:20.171598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.172122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.172835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.207433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:20.209758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:20.306218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1148/2276] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:20.315938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.316455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.316997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.344555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:20.347152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:20.374615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1129/2277] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:20.380626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.392633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bdb29-ccab-4378-96eb-d97b6490f589 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.398333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.404213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.422334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1149/2278] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:07:20.428512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.443979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931f9cd-4289-4715-9a21-b17721f01d85 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.450791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.451584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.451981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.452385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.453339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.455889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.579406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1130/2279] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:20.590311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.601385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac677b11-660c-4049-91ed-2404d7f904f2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.670931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.672147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.672661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.673169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.674526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.678396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.695753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:20.808951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1150/2280] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:20 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:20.814050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.826455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da917f-2237-43e7-8fc2-73d23c7f035a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.897182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.897182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.897182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.897182 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.898241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.898241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.898241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1131/2281] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:20.898783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.905347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2adde-f326-498a-9280-c1eb9a17d018 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.910945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.911663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.912319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.912710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.914270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.916515 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9952a-664d-4533-8ac7-a740a88fc65a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:20.931398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1151/2282] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:20.937245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:20.950905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043c8c7-8f97-4c00-98b9-fd1c2d042d45 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:20.956043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:20.956981 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:20.957356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:20.957758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] PATH_INFO: `/v3/projects/d753c4de91e64cbca9b2da8892f80292/users/d04f9c4f65c542a3a5c56043eaa27239/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:20.977560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d753c4de91e64cbca9b2da8892f80292, user_id=d04f9c4f65c542a3a5c56043eaa27239, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:20.980465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.114198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1132/2283] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:20 2022] PUT /identity/v3/projects/d753c4de91e64cbca9b2da8892f80292/users/d04f9c4f65c542a3a5c56043eaa27239/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:21.136315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.136812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.137363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.148954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:21.178239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] MFA Rules not processed for user `d04f9c4f65c542a3a5c56043eaa27239`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:21.179511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:21.271931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1152/2284] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:21.276491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.317301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:21.358430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4310-ed72-4996-9612-64f15aa93035 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.363738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.364433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.364717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.364995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.365707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.368058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.521522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1133/2285] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:21.528108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.539830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b02c-ed88-4341-bd7f-01f43f2ef9a7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.651866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.652580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.653431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.653722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.655951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.658601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.808552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1153/2286] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:21 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:21.811157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.826097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185c26-971b-4435-a3a1-00519714f95d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.830359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.831058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.831332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.831917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.832718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.835007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:21.847621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1134/2287] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:21.852909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:21.864289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44756dd-53f9-49ff-9b1e-44b6d82aaa7b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:21.869044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:21.869970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:21.870258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:21.870537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] PATH_INFO: `/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61/users/3a9098207e574b738018ede39a65e375/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:21.883161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:21.888085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d903fc5d2f2e40cb8f15e4d88bbbfc61, user_id=3a9098207e574b738018ede39a65e375, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:21.890846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.044171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1154/2288] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:21 2022] PUT /identity/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61/users/3a9098207e574b738018ede39a65e375/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:22.048368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.058812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5731-a329-455b-8f43-df4f18955c90 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.110027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:22.129340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.130547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.131066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.132540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.132727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.134690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438dce1-032a-4f74-aa28-c0ec9fdf93b9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.147343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1135/2289] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:22.152104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.176695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336f9f-2a97-42d2-b968-6ad5dd9c5a96 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.176695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.176695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.176695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.177420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] PATH_INFO: `/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61/users/3a9098207e574b738018ede39a65e375/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.177420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d903fc5d2f2e40cb8f15e4d88bbbfc61, user_id=3a9098207e574b738018ede39a65e375, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.177731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.287963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1155/2290] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:22 2022] PUT /identity/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61/users/3a9098207e574b738018ede39a65e375/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:22.294926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.295576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.295868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.325644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] MFA Rules not processed for user `3a9098207e574b738018ede39a65e375`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:22.326927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:22.420141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1136/2291] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:22.436537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:22.438397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:22.502467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314985-786e-4688-9b9f-da96de138ebf admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:22.506498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:22.509374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:22.509374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:22.509374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:22.517938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:22.519403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feaf301-f143-469c-9c6b-46704bc9f376 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:22.530264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1156/2292] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:23.955333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.034820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e5f40-764d-4399-981f-44b1c2c2c081 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.040850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.042481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.042995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.047286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] PATH_INFO: `/v3/users/d04f9c4f65c542a3a5c56043eaa27239` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.047286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04f9c4f65c542a3a5c56043eaa27239)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.049859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.328841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04f9c4f65c542a3a5c56043eaa27239'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:24.343153 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04f9c4f65c542a3a5c56043eaa27239'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:24.343887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04f9c4f65c542a3a5c56043eaa27239'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:24.348879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:24.351812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04f9c4f65c542a3a5c56043eaa27239'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:24.352541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04f9c4f65c542a3a5c56043eaa27239'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:24.493500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1137/2293] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:23 2022] DELETE /identity/v3/users/d04f9c4f65c542a3a5c56043eaa27239 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:24.498690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.499230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.499230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.518740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:24.519967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:24.581693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1157/2294] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:24.592295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:24.594568 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:24.674972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264fb9d-4432-4789-b005-d7154e052fb0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:24.678758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:24.679429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:24.679736 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:24.680013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:24.692053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:24.693647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:24.705220 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1138/2295] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:25.248563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:25.248563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:25.261277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f55e1-8dd4-473c-b656-422adae23a31 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:25.266465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:25.267539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:25.267898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:25.268256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] PATH_INFO: `/v3/projects/d753c4de91e64cbca9b2da8892f80292` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:25.269648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d753c4de91e64cbca9b2da8892f80292)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:25.271912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:25.419610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd753c4de91e64cbca9b2da8892f80292', 'request_id': 'req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.497777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd753c4de91e64cbca9b2da8892f80292', 'request_id': 'req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.504335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd753c4de91e64cbca9b2da8892f80292', 'request_id': 'req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.516788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] The token cache is being invalidate because project d753c4de91e64cbca9b2da8892f80292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:25.517068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.517786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.519464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1158/2296] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:25 2022] DELETE /identity/v3/projects/d753c4de91e64cbca9b2da8892f80292 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:25.523463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:25.536799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2ed19-02f5-409a-9977-28916914a255 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:25.632980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:25.634579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:25.635083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:25.635583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] PATH_INFO: `/v3/users/3a9098207e574b738018ede39a65e375` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:25.638344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9098207e574b738018ede39a65e375)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:25.642074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:25.845875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9098207e574b738018ede39a65e375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.859199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9098207e574b738018ede39a65e375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.859941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9098207e574b738018ede39a65e375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.867564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9098207e574b738018ede39a65e375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.868297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-05feca81-479d-4530-b348-69433700c3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9098207e574b738018ede39a65e375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:25.956627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1139/2297] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:25 2022] DELETE /identity/v3/users/3a9098207e574b738018ede39a65e375 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:26.441292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:26.442816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:26.451218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:26.456614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dcbe6-a97e-466e-9559-a6be7ce0f0a5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:26.528284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:26.529471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:26.529471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:26.529761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] PATH_INFO: `/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:26.531026 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d903fc5d2f2e40cb8f15e4d88bbbfc61)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:26.532987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:26.648368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd903fc5d2f2e40cb8f15e4d88bbbfc61', 'request_id': 'req-6547a5db-e78e-4733-a516-a4af7af1bcba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:26.739529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd903fc5d2f2e40cb8f15e4d88bbbfc61', 'request_id': 'req-6547a5db-e78e-4733-a516-a4af7af1bcba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:26.747471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd903fc5d2f2e40cb8f15e4d88bbbfc61', 'request_id': 'req-6547a5db-e78e-4733-a516-a4af7af1bcba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:26.759604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] The token cache is being invalidate because project d903fc5d2f2e40cb8f15e4d88bbbfc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:26.759900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:26.760575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6547a5db-e78e-4733-a516-a4af7af1bcba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:26.762896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1159/2298] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:26 2022] DELETE /identity/v3/projects/d903fc5d2f2e40cb8f15e4d88bbbfc61 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:26.768141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:26.768621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:26.768749 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:26.794539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:26.796102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:26.800303 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:26.864011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1140/2299] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:26.873257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:26.873546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:26.873826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:26.895855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:26.897379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:26.907148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1160/2300] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:26.911785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:26.922747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629945-1bf4-4504-8061-c3626e954fb5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:26.927549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:26.928226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:26.928514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:26.928793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:26.929533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:26.929839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:26.931482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:26.944091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1141/2301] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:26.950707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:26.961882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ac1e4-0679-493f-903e-b445dd83d2a8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:26.969159 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:26.970335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:26.970857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:26.971373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:26.972728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:26.976501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.142672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1161/2302] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:26 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:27.150557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.162597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a46e-dadb-49b0-883b-3c0c956e0cb2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:27.241289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:27.242039 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.242325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.242606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.243322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:27.245239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.347096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1142/2303] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:27 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:27.351433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.362901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27ee13-c100-4529-a24b-36b3a9692f49 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:27.367988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:27.368631 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.368842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.369118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.369861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:27.371489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.382775 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1162/2304] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:27.386778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.397055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbad6-4ab2-4939-855c-2ba9f034e4b0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:27.401964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:27.402693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.403538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.403825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.404575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:27.406193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edddb04-516b-41ce-ac24-45b20796e2cf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.417807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1143/2305] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:27.422348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.432871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833df60-2932-41a9-ab80-eafc3b08cc72 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:27.438158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:27.438637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.438921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.439198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] PATH_INFO: `/v3/projects/96d919d7077744bb9cb73007e6bc48d9/users/8933239bc4ca46b381f0f546e0524dda/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.468164 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d919d7077744bb9cb73007e6bc48d9, user_id=8933239bc4ca46b381f0f546e0524dda, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:27.471492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.541098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1163/2306] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:27 2022] PUT /identity/v3/projects/96d919d7077744bb9cb73007e6bc48d9/users/8933239bc4ca46b381f0f546e0524dda/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:27.553062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150636ad-adfa-449d-b019-866eca94920b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.553366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150636ad-adfa-449d-b019-866eca94920b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.553646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150636ad-adfa-449d-b019-866eca94920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.584130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-150636ad-adfa-449d-b019-866eca94920b None None] MFA Rules not processed for user `8933239bc4ca46b381f0f546e0524dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:27.585417 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-150636ad-adfa-449d-b019-866eca94920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:27.667047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1144/2307] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:27.672092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.708125 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:27.745551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49451c-f5d2-4aad-89ae-75e9768fb431 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:27.760671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:27.761436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:27.761726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:27.762047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:27.762797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:27.764743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:27.920336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1164/2308] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:27 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:27.922021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150636ad-adfa-449d-b019-866eca94920b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:27.934023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:27.951547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150636ad-adfa-449d-b019-866eca94920b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.020288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.021051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.021387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.021772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.022575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.024740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.099327 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1145/2309] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:27 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:28.103444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.115222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c558e-a7f2-4424-b066-6e533f921803 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.120382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.121066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.121832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.121832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.122466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.124355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.135490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1165/2310] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:28.140255 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.150507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1486d-4a92-47d2-bdf2-88945633a1e4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.155802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.156705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.156989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.157267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] PATH_INFO: `/v3/projects/c6ede3c3221f428eabd4cdb449d63c62/users/f0e17229feb644538b20534c773f3902/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.174118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ede3c3221f428eabd4cdb449d63c62, user_id=f0e17229feb644538b20534c773f3902, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.176609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.250625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1146/2311] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:28 2022] PUT /identity/v3/projects/c6ede3c3221f428eabd4cdb449d63c62/users/f0e17229feb644538b20534c773f3902/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:28.255399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.266481 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b85033-5f7c-47f9-ba14-c8c431f67062 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.325809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.326591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.326947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.327225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.327951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.329584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3fd01-da84-438f-8110-f08e28b0908c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.339703 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1166/2312] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:07:28.344449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.354913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eabe4-b695-481b-9127-78376976d631 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.362037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.362956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.363244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.363524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] PATH_INFO: `/v3/projects/c6ede3c3221f428eabd4cdb449d63c62/users/f0e17229feb644538b20534c773f3902/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.365541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ede3c3221f428eabd4cdb449d63c62, user_id=f0e17229feb644538b20534c773f3902, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.368308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.380720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1147/2313] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:28 2022] PUT /identity/v3/projects/c6ede3c3221f428eabd4cdb449d63c62/users/f0e17229feb644538b20534c773f3902/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:28.392573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.392968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.393401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.427969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] MFA Rules not processed for user `f0e17229feb644538b20534c773f3902`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:28.429175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:28.528084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1167/2314] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:28.540618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.544649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:28.607225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef8dda-9031-4104-a1e1-a92db9da24e6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.610929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.611609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.611897 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.612178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.622281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.623755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.633190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1148/2315] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:28.788926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:28.799509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354aa76-ed4d-4668-b0e1-184b4f0e824f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:28.803934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:28.804151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:28.804394 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:28.804672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:28.828892 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:28.876030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:28.878053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559758c-4f34-4596-9a10-84cfd7948114 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:28.891617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1168/2316] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:29.458576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:29.538805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787183-5677-4573-85fc-ff392a854c50 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:29.543965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:29.544862 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:29.545147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:29.545426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] PATH_INFO: `/v3/users/8933239bc4ca46b381f0f546e0524dda` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:29.546693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8933239bc4ca46b381f0f546e0524dda)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:29.548635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:29.550450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:29.747782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8933239bc4ca46b381f0f546e0524dda'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:29.761034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8933239bc4ca46b381f0f546e0524dda'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:29.761782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8933239bc4ca46b381f0f546e0524dda'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:29.769072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8933239bc4ca46b381f0f546e0524dda'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:29.769932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8933239bc4ca46b381f0f546e0524dda'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:29.851473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1149/2317] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:29 2022] DELETE /identity/v3/users/8933239bc4ca46b381f0f546e0524dda => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:29.857194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:29.857720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:29.857978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:29.877241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:29.878491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:29.941991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1169/2318] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:29.952012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:29.953447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:30.016096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611a5f3-98a1-42e0-9b10-3bd0a992597c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:30.020065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:30.026101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:30.026101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:30.026101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:30.031229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:30.032662 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:30.042385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1150/2319] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:30.570144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:30.575510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:30.585799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271252b-a0e9-4db8-bb0b-570c48eb4398 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:30.590836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:30.591721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:30.592007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:30.592284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] PATH_INFO: `/v3/projects/96d919d7077744bb9cb73007e6bc48d9` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:30.593536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d919d7077744bb9cb73007e6bc48d9)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:30.595522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:30.730837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d919d7077744bb9cb73007e6bc48d9', 'request_id': 'req-092ab7db-02c9-49d5-a41b-312fdad39b63'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.817286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d919d7077744bb9cb73007e6bc48d9', 'request_id': 'req-092ab7db-02c9-49d5-a41b-312fdad39b63'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.823539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d919d7077744bb9cb73007e6bc48d9', 'request_id': 'req-092ab7db-02c9-49d5-a41b-312fdad39b63'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.841121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] The token cache is being invalidate because project 96d919d7077744bb9cb73007e6bc48d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:30.841407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.842119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:30.846955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1170/2320] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:30 2022] DELETE /identity/v3/projects/96d919d7077744bb9cb73007e6bc48d9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:30.848970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:30.862250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc56131-e39d-4f0d-b825-42c594f8b85f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:30.932162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:30.933402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:30.933402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:30.933685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] PATH_INFO: `/v3/users/f0e17229feb644538b20534c773f3902` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:30.944641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e17229feb644538b20534c773f3902)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:30.946886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:30.975022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:31.251510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e17229feb644538b20534c773f3902'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.265541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e17229feb644538b20534c773f3902'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.266281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e17229feb644538b20534c773f3902'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.273729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e17229feb644538b20534c773f3902'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.274455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-08451d64-b67b-4a36-9fb9-b99f13f6c0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e17229feb644538b20534c773f3902'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:31.372391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1151/2321] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:30 2022] DELETE /identity/v3/users/f0e17229feb644538b20534c773f3902 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:31.882846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:31.884785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:31.899503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab7db-02c9-49d5-a41b-312fdad39b63 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:31.964645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:31.977718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:31.978632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:31.978909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:31.979182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] PATH_INFO: `/v3/projects/c6ede3c3221f428eabd4cdb449d63c62` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:31.980408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ede3c3221f428eabd4cdb449d63c62)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:31.982492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.145420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ede3c3221f428eabd4cdb449d63c62', 'request_id': 'req-f1e06eb4-ff0e-42b6-a541-f051b527bd31'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.327620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ede3c3221f428eabd4cdb449d63c62', 'request_id': 'req-f1e06eb4-ff0e-42b6-a541-f051b527bd31'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.335587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ede3c3221f428eabd4cdb449d63c62', 'request_id': 'req-f1e06eb4-ff0e-42b6-a541-f051b527bd31'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.351885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] The token cache is being invalidate because project c6ede3c3221f428eabd4cdb449d63c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:32.352553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.353772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1e06eb4-ff0e-42b6-a541-f051b527bd31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:32.355758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1171/2322] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:31 2022] DELETE /identity/v3/projects/c6ede3c3221f428eabd4cdb449d63c62 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:32.361550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.362083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.362165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.387106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:32.389350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:32.486542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1152/2323] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:32.493224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.493544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.493963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.520801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:32.523108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:32.542407 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1172/2324] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:32.555156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:32.575073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd296d-b868-4df5-801b-20f894b44268 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:32.584078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:32.585985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.587013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.587558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.599441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:32.599441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:32.599441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.622551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1153/2325] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:32.627702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:32.649024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1d242-580a-4e48-bd32-c68605928a4b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:32.660744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:32.661678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.662228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.662607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.663452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:32.665769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.764071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1173/2326] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:32 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:32.768808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:32.785106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047525b2-2e7d-4c45-9831-e7225a17e06e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:32.861686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:32.862501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.862785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.863215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.863878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:32.866055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.958091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1154/2327] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:32 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:32.962321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:32.973318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb615093-dbe0-431a-8994-78e00dbeea03 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:32.978614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:32.979374 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:32.979789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:32.980179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:32.981463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:32.983287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:32.998708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1174/2328] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:33.007905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:33.021610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7fb43-d7ed-4117-ba32-710d9b414be7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:33.026803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:33.027496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.027835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.028628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.029377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:33.031084 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0f4f-503a-49b6-ac75-7994d43fa33a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:33.044146 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1155/2329] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:33.048691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:33.060435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc074b-36c7-4773-a26e-9216f7e8c98a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:33.065732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:33.070704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.070704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.070704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] PATH_INFO: `/v3/projects/554cc4a2e5a34cf8829b6774ea5d6292/users/14e99460ff6546a3b229ddcc021646a7/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.085217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554cc4a2e5a34cf8829b6774ea5d6292, user_id=14e99460ff6546a3b229ddcc021646a7, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:33.088468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:33.239142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1175/2330] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:33 2022] PUT /identity/v3/projects/554cc4a2e5a34cf8829b6774ea5d6292/users/14e99460ff6546a3b229ddcc021646a7/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:33.250809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.251098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.251377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.266183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:33.286730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] MFA Rules not processed for user `14e99460ff6546a3b229ddcc021646a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:33.288000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:33.380248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1156/2331] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:33.392388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:33.394569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:33.494090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41628e-206b-444f-8453-1ce8ec3eaaf7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:33.500648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:33.501824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.502383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.502893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.520567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:33.523581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85a4d-3433-4fb0-b278-7bd3afcb44b8 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:33.540490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1176/2332] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:33.575401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:33.745397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f6c5-3792-4b34-a881-e4c0630f1506 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:33.750995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:33.753231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:33.753231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:33.753231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] PATH_INFO: `/v3/users/14e99460ff6546a3b229ddcc021646a7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:33.755165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e99460ff6546a3b229ddcc021646a7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:33.758963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:33.997780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e99460ff6546a3b229ddcc021646a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:34.029790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e99460ff6546a3b229ddcc021646a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:34.034615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e99460ff6546a3b229ddcc021646a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:34.046159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e99460ff6546a3b229ddcc021646a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:34.047201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e99460ff6546a3b229ddcc021646a7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:34.169179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1157/2333] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:33 2022] DELETE /identity/v3/users/14e99460ff6546a3b229ddcc021646a7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:34.169457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.169457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.170390 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.213723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:34.215907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:34.233827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:34.329254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1177/2334] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:34.343699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:34.346000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:34.373032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:34.423882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d384-b815-451c-8fb3-7395d42fdcc1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:34.429588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:34.430646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:34.431123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:34.431519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:34.443946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:34.445935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc502a7-cd21-4334-91fc-230ad50d3113 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:34.460023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1158/2335] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:35.038772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.040642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:35.055862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a0770-4594-4e48-8d38-f4547ed10805 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.062057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.063806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.064261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.068299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] PATH_INFO: `/v3/projects/554cc4a2e5a34cf8829b6774ea5d6292` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.068299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554cc4a2e5a34cf8829b6774ea5d6292)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.071384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.268944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554cc4a2e5a34cf8829b6774ea5d6292', 'request_id': 'req-bb261a28-aedb-4364-b9dc-249ae9497e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:35.362293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554cc4a2e5a34cf8829b6774ea5d6292', 'request_id': 'req-bb261a28-aedb-4364-b9dc-249ae9497e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:35.368413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554cc4a2e5a34cf8829b6774ea5d6292', 'request_id': 'req-bb261a28-aedb-4364-b9dc-249ae9497e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:35.384569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] The token cache is being invalidate because project 554cc4a2e5a34cf8829b6774ea5d6292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:35.384856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:35.385530 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb261a28-aedb-4364-b9dc-249ae9497e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:35.387141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1178/2336] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:35 2022] DELETE /identity/v3/projects/554cc4a2e5a34cf8829b6774ea5d6292 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:35.393167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.393457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.393733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.413493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:35.414784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:35.479207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1159/2337] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:35.487035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.487328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.487607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.506247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:35.507455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:35.516110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1179/2338] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:35.520418 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.531529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49aee-9360-4dd9-a1ba-5d8829df9dc2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.536446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.537192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.537474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.538362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.538698 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:07:35.539131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.540666 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.554027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1160/2339] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:07:35.561214 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.573099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8078dc-d2d3-4f6d-b9b9-55158a81553b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.579171 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.579905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.580326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.580670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.581446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.583759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.673708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1180/2340] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:35.677742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.689164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac8240-2309-4b70-94c4-574d79db060b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.783789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.785663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.785663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.786059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.787350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.791386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.949384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1161/2341] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:35 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:07:35.955246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:35.966408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02cb0d-1738-406d-84b4-ddb3f67029ed admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:35.971422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:35.972111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:35.972398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:35.972684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:35.973431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:35.975195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:35.987271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1181/2342] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:35.992000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:36.003106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a7d23-5dfd-48db-a06c-f6e234890e01 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:36.007833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:36.008510 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.008791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.009063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.009855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.011451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cf335-7103-4872-9a29-b55dd4995679 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.023004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1162/2343] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:36.028480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:36.046376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2792e2-bb65-41d4-b5a7-77ebd1c775f8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:36.051423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:36.052322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.052609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.052890 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] PATH_INFO: `/v3/projects/8e511490c0f8438fb89ac590bd63529f/users/546cd066c4244bffacbfea21f5e4f437/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.069535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e511490c0f8438fb89ac590bd63529f, user_id=546cd066c4244bffacbfea21f5e4f437, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.072333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.156121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1182/2344] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:36 2022] PUT /identity/v3/projects/8e511490c0f8438fb89ac590bd63529f/users/546cd066c4244bffacbfea21f5e4f437/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:36.161616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc10da-c550-44ae-ab76-d77a2113e318 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.163586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc10da-c550-44ae-ab76-d77a2113e318 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.163586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc10da-c550-44ae-ab76-d77a2113e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.182228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-63dc10da-c550-44ae-ab76-d77a2113e318 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:36.183477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-63dc10da-c550-44ae-ab76-d77a2113e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:36.204277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:36.254989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1163/2345] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:07:36.265838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:36.267836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:36.314420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:36.333292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486363c-c7e4-4196-8184-3824f2bf6f40 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:36.339152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:36.339916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:36.340285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:36.341120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:36.359705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:36.362628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f9c5-72ec-4f3f-839f-fbe52f6462ab service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:36.382342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1183/2346] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:43.176040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.176040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.176040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:43.206424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] MFA Rules not processed for user `757f0e0a07754669b7cb9f21502e5906`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:43.206424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:43.292975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1164/2347] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:43.991712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:43.992661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:43.993163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.042960 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] MFA Rules not processed for user `546cd066c4244bffacbfea21f5e4f437`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:44.045048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:44.157130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1184/2348] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:44.160608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.181317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb348bd-0b71-492c-8f2f-ce6a084b9a9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.189171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.189926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.190657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.191164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.192199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.194901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.370070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1165/2349] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:44.376196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.389121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5d59-b970-40a5-94fe-3a26bbf1cf24 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.449385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.450172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.450461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.450739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.451450 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.453363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.574523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1185/2350] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:07:44 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:07:44.574848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.585710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092d1b2-361a-4cdb-839e-bceb51ce2eee admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.598872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.601104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.601104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.601104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.601769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.604384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.618572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1166/2351] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:44.623293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.634958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4f474-03ba-41a8-a284-a4adf35b8930 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.640281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.646747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.646747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.646747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] PATH_INFO: `/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe/users/c26f7377a97644c9830190f41db9ec35/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.662201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e5f9a52ba444c9aeec8d8f0ac5e5fe, user_id=c26f7377a97644c9830190f41db9ec35, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.665229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.744278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1186/2352] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:44 2022] PUT /identity/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe/users/c26f7377a97644c9830190f41db9ec35/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:44.749065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.761848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2d33-0d04-44f3-b84b-1a267ca2d627 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.845865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.846604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.846891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.847170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.847916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.849548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.865079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1167/2353] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:07:44.869286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:44.882654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a64949-6189-44a2-94d9-ba9d5eb5964c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:44.892081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:44.896237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:44.897883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:44.898888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] PATH_INFO: `/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe/users/c26f7377a97644c9830190f41db9ec35/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:44.903640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e5f9a52ba444c9aeec8d8f0ac5e5fe, user_id=c26f7377a97644c9830190f41db9ec35, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:44.909648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad51506-31ad-4f86-8f28-693235d70b19 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:44.931994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1187/2354] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:07:44 2022] PUT /identity/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe/users/c26f7377a97644c9830190f41db9ec35/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:07:47.618022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:47.619909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:47.633401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a5c8c-e3b4-4bdb-8ee0-60a27f7beca7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:47.673855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:47.724015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:47.730916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:47.731960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:47.732559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] PATH_INFO: `/v3/users/0133cf5666e944baa3399ff8ed76279b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:47.749481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0133cf5666e944baa3399ff8ed76279b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:47.751962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.194447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0133cf5666e944baa3399ff8ed76279b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:48.221752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0133cf5666e944baa3399ff8ed76279b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:48.226792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0133cf5666e944baa3399ff8ed76279b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:48.255796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0133cf5666e944baa3399ff8ed76279b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:48.256486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0133cf5666e944baa3399ff8ed76279b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:48.393360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1168/2355] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:07:47 2022] DELETE /identity/v3/users/0133cf5666e944baa3399ff8ed76279b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:48.398307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.398792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.398912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.437741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:48.444846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.459291 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:48.588149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1188/2356] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:48.599974 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:48.601533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:48.764015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4df96-c1f5-4bcb-8884-3c6945e45467 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:48.770846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:48.773600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:48.773997 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:48.774428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:48.787056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:48.788618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf9ee9-fef4-4ccd-bc62-2595e9eb90cb service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:48.801269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1169/2357] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:07:49.730836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:49.734110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:49.774992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80eee8-798d-4c1e-91c1-91b806244ee1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:49.782516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:49.783893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.784616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.785373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] PATH_INFO: `/v3/projects/4271cc6629ca4c36b7d741295979866b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.790117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4271cc6629ca4c36b7d741295979866b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:49.800319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:49.904441 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:49.904985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:49.905225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:49.938879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:49.941385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:49.965598 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4271cc6629ca4c36b7d741295979866b', 'request_id': 'req-9f00df42-7b02-4910-87b8-68a47d4d966f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.029071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:50.032631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1170/2358] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:50.045575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:50.047250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:50.128536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9ea62-549e-4798-a4d8-bf63695d8ed9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:50.134463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:50.135149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:50.135432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:50.135702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:50.145746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:50.147556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2a5cf-994f-4dfb-891e-ae7ce8194a34 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:50.158053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1171/2359] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:07:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:07:50.209063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4271cc6629ca4c36b7d741295979866b', 'request_id': 'req-9f00df42-7b02-4910-87b8-68a47d4d966f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.222054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4271cc6629ca4c36b7d741295979866b', 'request_id': 'req-9f00df42-7b02-4910-87b8-68a47d4d966f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.243211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] The token cache is being invalidate because project 4271cc6629ca4c36b7d741295979866b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:07:50.243575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.244809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:07:50.268721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1189/2360] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:07:49 2022] DELETE /identity/v3/projects/4271cc6629ca4c36b7d741295979866b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:07:54.974183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d34864-edfd-4da7-bc7a-54696b5a892b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:54.974953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d34864-edfd-4da7-bc7a-54696b5a892b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:54.974953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d34864-edfd-4da7-bc7a-54696b5a892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.043540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-31d34864-edfd-4da7-bc7a-54696b5a892b None None] MFA Rules not processed for user `c26f7377a97644c9830190f41db9ec35`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:07:55.043830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-31d34864-edfd-4da7-bc7a-54696b5a892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.215147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1172/2361] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:07:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:07:55.223474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:07:55.225238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.351399 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00df42-7b02-4910-87b8-68a47d4d966f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:07:55.361264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:07:55.362475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:07:55.363000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:07:55.363521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:07:55.366861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:07:55.396432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:07:55.442363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:07:55.444106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861783a7-4aa4-40ef-ae7d-dfa7e794676f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:07:55.469365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1190/2362] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:07:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:05.203388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=66 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:06.854011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=18 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:14.654612 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:14.655105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:14.655208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:14.656566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1173/2363] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:08:14.662734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6f5b-2ad8-4b35-a65b-6cd788e8f3d9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:14.663259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6f5b-2ad8-4b35-a65b-6cd788e8f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:14.663367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd6f5b-2ad8-4b35-a65b-6cd788e8f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:14.704794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0bcd6f5b-2ad8-4b35-a65b-6cd788e8f3d9 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:14.706057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0bcd6f5b-2ad8-4b35-a65b-6cd788e8f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:14.715753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1191/2364] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:14.727558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:14.729336 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:14.829379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeda0d-b798-42ac-bb2e-6893d49573ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:14.833095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:14.834059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:14.834345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:14.834629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:14.845859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:14.847350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1353a7-264e-4fbd-8de0-deb4d391d71a service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:14.859163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1174/2365] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:08:15.089805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.090051 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.090313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.092396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1192/2366] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 21:08:15.097120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c58a-5449-43e8-a233-cb6a5134b288 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.097462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c58a-5449-43e8-a233-cb6a5134b288 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.097748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1c58a-5449-43e8-a233-cb6a5134b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.116712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d0c1c58a-5449-43e8-a233-cb6a5134b288 None None] MFA Rules not processed for user `fb92fb4d1d124af781f1dc10ca2cb4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:15.117952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d0c1c58a-5449-43e8-a233-cb6a5134b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:15.172149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1175/2367] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:15.184957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:15.186634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:15.201144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77000b4-3a22-485c-9c1a-9ee08382118f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:15.205059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:15.205712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.206197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.206313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.214986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:15.217048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb16f5-b03f-4efe-8fb2-feaa482f5e0a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:15.225371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1193/2368] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:15.312835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.313259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.313653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.315246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1176/2369] 10.222.0.55 () {54 vars in 921 bytes} [Tue May 31 21:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 21:08:15.320627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.320912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.321195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.339793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] MFA Rules not processed for user `0ac9c94438bf4a0b8a603d472ca317f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:15.341566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:15.350969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1194/2370] 10.222.0.55 () {58 vars in 1018 bytes} [Tue May 31 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:15.362428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:15.364308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:15.377673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb58f17-0369-4636-b57d-7e00e200d006 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:15.381273 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:15.381952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:15.382231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:15.382508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:15.393502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:15.395008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:15.407961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1177/2371] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:19.314842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:19.324187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbfdb9-5a10-44a8-9fe7-f2e7ae8a59e3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:19.327860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:19.328528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:19.328813 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:19.329088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:19.330946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:19.344949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:19.346491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342195-e3d1-4f2a-8062-17926d326ba6 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:19.358195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1195/2372] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:08:20.539524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:20.548711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba251-77fd-4c04-b2dd-f9eeabd894bc service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:20.552674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:20.553326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:20.553613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:20.553912 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:20.555708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:20.570766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:20.572214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:20.585936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1178/2373] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:08:22.124101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff29d1-40cb-4ece-a79e-16160897769d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:22.124595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff29d1-40cb-4ece-a79e-16160897769d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:22.124806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff29d1-40cb-4ece-a79e-16160897769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:22.146823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1bff29d1-40cb-4ece-a79e-16160897769d None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:22.148123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1bff29d1-40cb-4ece-a79e-16160897769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:22.156524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1196/2374] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:22.183245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:22.183245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:22.196879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd5e8c-cf17-481b-a050-113abb1a12c0 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:22.205683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:22.206602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:22.206911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:22.207367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:22.217849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:22.219475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:22.230669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1179/2375] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:08:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:08:24.888459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129c53-934a-41ee-8260-eac84a815573 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:24.889580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129c53-934a-41ee-8260-eac84a815573 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:24.890191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129c53-934a-41ee-8260-eac84a815573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:24.910933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-06129c53-934a-41ee-8260-eac84a815573 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:24.912209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-06129c53-934a-41ee-8260-eac84a815573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:24.920066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1197/2376] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:24.933822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:24.945149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2c762-dd1c-432d-ba43-286c0d2b686f service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:24.954078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:24.954737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:24.955020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:24.955297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:24.965356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:24.967540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:24.980218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1180/2377] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:08:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:08:26.406912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:26.407902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:26.407902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:26.444097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] MFA Rules not processed for user `546cd066c4244bffacbfea21f5e4f437`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:26.446655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:26.466022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1198/2378] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:08:27.009424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:27.023703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3e17-3ba2-4fd4-aa51-1a251970db09 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:27.031249 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:27.032467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:27.033011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:27.033831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:27.037713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:27.086043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:27.086043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:27.145037 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1181/2379] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:28.879344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:28.880975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:28.968038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2254994-06b1-4e14-ab8a-ad90ffab5817 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:28.974306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:28.975067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:28.975365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:28.978040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:28.986168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:28.999489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:29.001363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed5cb-be8c-48bd-8eb3-ce23a8d9a4cd service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:29.013864 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1199/2380] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:37.101149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:37.103076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:37.122366 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:37.128963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be784-da9d-4a42-a00d-716e32622f17 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:37.135848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:37.137324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:37.138647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:37.139196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:37.143759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:37.245874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:37.249317 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:37.287251 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1182/2381] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:39.008575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=65 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:40.321341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:40.328451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:40.328451 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:40.344168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:40.345396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:40.357302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1200/2382] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:08:40.367396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:40.394790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b6eb9-250b-41e6-b1ad-789f747b095d service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:40.407748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:40.412491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:40.412491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:40.412491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:40.418571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:40.420173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:40.430915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1183/2383] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:08:43.745004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:43.746535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:43.815079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfef07-1a5f-431a-a9b8-2df063468f96 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:43.819872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:43.820741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:43.822406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:43.822406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] PATH_INFO: `/v3/users/757f0e0a07754669b7cb9f21502e5906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:43.822624 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=757f0e0a07754669b7cb9f21502e5906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:43.824468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:44.010054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757f0e0a07754669b7cb9f21502e5906'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.022954 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757f0e0a07754669b7cb9f21502e5906'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.023953 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757f0e0a07754669b7cb9f21502e5906'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.035427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757f0e0a07754669b7cb9f21502e5906'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.036162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757f0e0a07754669b7cb9f21502e5906'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.111557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1201/2384] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:08:43 2022] DELETE /identity/v3/users/757f0e0a07754669b7cb9f21502e5906 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:44.410060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:44.422268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb0ac-d2e7-43fd-b456-ea4bf7dc27d2 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:44.497459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:44.498508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:44.498791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:44.499063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] PATH_INFO: `/v3/projects/f722e284eda84b078c1c6935fb728f82` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:44.500275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f722e284eda84b078c1c6935fb728f82)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:44.502268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:44.631537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f722e284eda84b078c1c6935fb728f82', 'request_id': 'req-efac42d1-6937-4178-8eb2-da3a39db3f12'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.640088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f722e284eda84b078c1c6935fb728f82', 'request_id': 'req-efac42d1-6937-4178-8eb2-da3a39db3f12'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.645469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f722e284eda84b078c1c6935fb728f82', 'request_id': 'req-efac42d1-6937-4178-8eb2-da3a39db3f12'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.717488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] The token cache is being invalidate because project f722e284eda84b078c1c6935fb728f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:08:44.718000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.718836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efac42d1-6937-4178-8eb2-da3a39db3f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:08:44.720710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1184/2385] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:08:44 2022] DELETE /identity/v3/projects/f722e284eda84b078c1c6935fb728f82 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:08:45.518375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:45.520161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:45.601174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46925-d6c5-4762-97b9-cdedd4284dce admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:08:45.640620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:45.674480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:08:45.675306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:45.675588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:45.675881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:45.678199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:45.692774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:08:45.695479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:08:45.713084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1202/2386] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:08:54.713575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:55.916619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=13 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:08:59.841697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:08:59.842227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:08:59.842450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:08:59.862192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:08:59.863463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:08:59.923056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1185/2387] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:08:59.936947 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:08:59.938536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:00.024088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075517-fdf0-4e89-92fc-7975327bba58 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:00.030680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:00.031414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:00.032205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:00.034758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:00.047588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:00.049403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:00.059633 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1203/2388] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:09:00.733346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:00.735244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:00.835476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6cc3-61b6-4e7b-a43d-e159a62b9b9c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:00.842802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:00.843442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:00.843650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:00.844105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:00.846884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:00.917322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:00.919031 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:00.929177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1186/2389] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:09:02.108702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:02.110826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:02.126773 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1452-f3c0-445b-bddb-6dfec2c379c2 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:02.132106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:02.132751 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:02.133030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:02.133306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:02.135075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:02.147033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:02.148601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:02.159461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1204/2390] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:09:05.594253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:05.595725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:05.609549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3897-057e-422d-abb7-fca0587aecb7 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:05.613237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:05.613909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:05.614204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:05.614480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:05.616267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:05.660723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:05.682989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:05.684415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:05.694373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1187/2391] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:09:07.727352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:07.740064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242974a9-3d26-4295-b81d-7295f9865067 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:07.745812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:07.746490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:07.746770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:07.747064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:07.749502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:07.762258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:07.763979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac3207-b2df-41a8-8e52-4e3c561fa1ff service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:07.774835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1205/2392] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:09:15.695261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=11 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:17.770122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=44 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:25.163547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:09:25.176105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b1684-042f-4c3a-9ad0-caf816c1b43e service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:09:25.181477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:09:25.182145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:25.182431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:25.182706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:25.184573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:25.247270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:09:25.249439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:09:25.259833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1188/2393] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:09:35.254728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=28 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:09:37.176575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:09:37.177138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:09:37.177138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:09:37.196330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] MFA Rules not processed for user `bbf377756836405d804d2aaba6e44c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:09:37.197531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:09:37.205071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1206/2394] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:09:47.191010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:10.671610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:10.684173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aa32b-b7a6-455c-9396-a6a25a4085d3 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:10.691089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:10.691831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:10.692274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:10.692619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:10.694466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:10.757521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:10.759379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805eb1c-5bdf-4a32-a4ec-1daf052bad56 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:10.770579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1189/2395] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:14.987422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:15.013602 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96825a-86f3-489b-b14e-0bad9dcfad67 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:15.021282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:15.022233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:15.022816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:15.023312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:15.025667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:15.040882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:15.042726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b59a2-b818-47c4-960c-d7b4265fda5c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:15.060774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1207/2396] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:19.792541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:19.793086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:19.793086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:19.810937 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] MFA Rules not processed for user `2d69edafe80649d4aff602b692e294c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:10:19.812201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:19.869917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1190/2397] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:10:20.209919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:20.210446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:20.210557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:20.229021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:10:20.230417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:20.237640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1208/2398] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:10:20.403552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:20.415757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7cb59-176a-4346-9959-1fa9037cda45 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:20.420872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:20.421615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:20.421814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:20.422126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:20.431348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:20.436727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:20.442115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1191/2399] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:10:21.583547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:21.593620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54841b01-f11b-4ffb-a9e4-0fba723f3347 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:21.597409 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:21.598097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:21.598385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:21.598670 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:21.600499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:21.669973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:21.671426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:21.682661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1209/2400] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:25.891349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:25.893690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:25.970076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a464f9f-e30e-4d19-b4da-7da0b4a5a299 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:25.975050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:25.975694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:25.976082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:25.976364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:25.978136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:25.989365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:25.990973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:26.001932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1192/2401] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:29.790083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:29.805732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323676e-77dc-41c8-bf6a-7feb8165ff9c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:29.811622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:29.812290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:29.812582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:29.812904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:29.814827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:29.827462 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:29.829575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:29.842088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1210/2402] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:10:29.919890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:29.921333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:29.936227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20c6d9-a603-4442-9495-e64d5509f91f service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:29.940708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:29.941592 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:29.941874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:29.942191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] PATH_INFO: `/v3/users/107ed6d5d4524a29a1c545cba5e8f5bf` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:29.943391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=107ed6d5d4524a29a1c545cba5e8f5bf)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:29.945294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:29.960301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:30.185385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107ed6d5d4524a29a1c545cba5e8f5bf'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.198938 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107ed6d5d4524a29a1c545cba5e8f5bf'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.199656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107ed6d5d4524a29a1c545cba5e8f5bf'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.210219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107ed6d5d4524a29a1c545cba5e8f5bf'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.210219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107ed6d5d4524a29a1c545cba5e8f5bf'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.290868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1193/2403] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:10:29 2022] DELETE /identity/v3/users/107ed6d5d4524a29a1c545cba5e8f5bf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:10:30.550073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:30.562613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b93d9-831b-4cfa-85fa-40b483109114 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:30.625082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:30.626985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:30.626985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:30.627155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] PATH_INFO: `/v3/projects/9f9ac73d84244b1c9029586fa4969bbf` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:30.628550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9ac73d84244b1c9029586fa4969bbf)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:30.630494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:30.761836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9ac73d84244b1c9029586fa4969bbf', 'request_id': 'req-7acd9441-b69e-48a9-bab2-ea8d33afdcad'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.873614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9ac73d84244b1c9029586fa4969bbf', 'request_id': 'req-7acd9441-b69e-48a9-bab2-ea8d33afdcad'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.879579 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:30.881735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9ac73d84244b1c9029586fa4969bbf', 'request_id': 'req-7acd9441-b69e-48a9-bab2-ea8d33afdcad'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.891907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] The token cache is being invalidate because project 9f9ac73d84244b1c9029586fa4969bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:10:30.892206 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.892845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:30.894429 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1211/2404] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:10:30 2022] DELETE /identity/v3/projects/9f9ac73d84244b1c9029586fa4969bbf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:10:30.898608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:30.900169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:30.914877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f25840-4799-4c1f-84f4-9680b17ec27b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:30.972655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:30.973556 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:30.973842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:30.974139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] PATH_INFO: `/v3/users/89ca4a8f01e649069947c4771373de97` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:30.975320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ca4a8f01e649069947c4771373de97)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:30.977322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:31.113026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ca4a8f01e649069947c4771373de97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.125726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ca4a8f01e649069947c4771373de97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.126530 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ca4a8f01e649069947c4771373de97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.133544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ca4a8f01e649069947c4771373de97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.134215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ed7a0ae7-076e-46f5-8177-f7dad98ac032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ca4a8f01e649069947c4771373de97'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.189763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1194/2405] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:10:30 2022] DELETE /identity/v3/users/89ca4a8f01e649069947c4771373de97 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:10:31.447939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:10:31.449607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:10:31.463906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9441-b69e-48a9-bab2-ea8d33afdcad admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:10:31.528998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:10:31.530539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:10:31.530827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:10:31.531100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] PATH_INFO: `/v3/projects/27a0be1912904cfab18f0faadd40af9e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:10:31.533180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a0be1912904cfab18f0faadd40af9e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:10:31.535244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:10:31.676201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a0be1912904cfab18f0faadd40af9e', 'request_id': 'req-4d802dc8-5a85-451b-aa62-056d560a2a01'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.772518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a0be1912904cfab18f0faadd40af9e', 'request_id': 'req-4d802dc8-5a85-451b-aa62-056d560a2a01'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.778686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a0be1912904cfab18f0faadd40af9e', 'request_id': 'req-4d802dc8-5a85-451b-aa62-056d560a2a01'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.792270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] The token cache is being invalidate because project 27a0be1912904cfab18f0faadd40af9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:10:31.792558 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.793235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:10:31.794829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1212/2406] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:10:31 2022] DELETE /identity/v3/projects/27a0be1912904cfab18f0faadd40af9e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:10:41.185623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:10:41.788874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:01.434677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:01.437631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:01.437631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:01.453125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] MFA Rules not processed for user `92d56ad8d4ab4c1099263a3d1c43490a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:01.454436 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:01.512480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1195/2407] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:11.182676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:11.184087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:11.243983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802dc8-5a85-451b-aa62-056d560a2a01 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:11.248362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:11.248978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:11.249660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:11.249660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:11.252061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:11.322330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:11.323764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:11.333226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1213/2408] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:11:11.505135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=25 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:14.956718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:14.958225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:14.977192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d322-9f34-4383-a3e8-67faf4a1f1be None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:14.982243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:14.983260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:14.983609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:14.984015 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] PATH_INFO: `/v3/users/bbf377756836405d804d2aaba6e44c1f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:14.985372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf377756836405d804d2aaba6e44c1f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:14.987526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:15.224211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf377756836405d804d2aaba6e44c1f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.239010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf377756836405d804d2aaba6e44c1f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.239760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf377756836405d804d2aaba6e44c1f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.247679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf377756836405d804d2aaba6e44c1f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.248376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8e39c4c1-ac06-4702-93f2-dc7caeb16b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf377756836405d804d2aaba6e44c1f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.331954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1196/2409] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:11:14 2022] DELETE /identity/v3/users/bbf377756836405d804d2aaba6e44c1f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:15.589421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:15.603300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf2201-da31-43de-a327-922034a0b8d1 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:15.662923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:15.663789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:15.664096 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:15.664371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] PATH_INFO: `/v3/projects/f1b54ceb69fc4041b743a11eda4144a8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:15.665543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b54ceb69fc4041b743a11eda4144a8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:15.667488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:15.769225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b54ceb69fc4041b743a11eda4144a8', 'request_id': 'req-897b9f6e-d616-4574-8bd7-a3bde9ce370b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.771905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:15.869278 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b54ceb69fc4041b743a11eda4144a8', 'request_id': 'req-897b9f6e-d616-4574-8bd7-a3bde9ce370b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.875277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b54ceb69fc4041b743a11eda4144a8', 'request_id': 'req-897b9f6e-d616-4574-8bd7-a3bde9ce370b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.886636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] The token cache is being invalidate because project f1b54ceb69fc4041b743a11eda4144a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:11:15.886923 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.887557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-897b9f6e-d616-4574-8bd7-a3bde9ce370b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:11:15.889337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1214/2410] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:11:15 2022] DELETE /identity/v3/projects/f1b54ceb69fc4041b743a11eda4144a8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:15.894892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:15.895191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:15.895506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:15.913586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:15.915337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:15.974245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1197/2411] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:15.982361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:15.982651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:15.982931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.001398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:16.002648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:16.010982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1215/2412] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:16.015212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.024634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8d36-c50c-48c9-8a63-d90aaa61faa5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.029183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.029839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.030157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.030434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.031169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:11:16.031476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.033060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.045445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1198/2413] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:11:16.049687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.059764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2e1a0-9251-492b-b3aa-0915484ceef4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.064418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.065069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.065352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.065626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.066360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.068276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.207786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1216/2414] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:11:16 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:11:16.213016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.223104 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f801-edda-49b0-b79d-fa935ba53097 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.281311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.281885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.282199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.282478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.283189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.285097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.292710 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:16.423973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1199/2415] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:11:16 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:11:16.428442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.439041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a950c-178d-4444-81ad-79a9ddbe368f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.443523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.444176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.444490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.444778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.445534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.447166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.458542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1217/2416] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:11:16.464910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.478788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282b1c-b06c-4c35-bff7-1d6932d2e63d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.484490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.485202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.485489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.490678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.490678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.490678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de553e7a-1df8-488b-8fa5-d438da1f334c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.500683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1200/2417] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:11:16.504932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.516488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ac051-21ae-4df7-846f-c1865e99747b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.521230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.522235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.522585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.522934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] PATH_INFO: `/v3/projects/69b2364f40d14160adf0220d92adaad7/users/8efe37a6d57b4775b4e47a295c3f5eee/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.539331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b2364f40d14160adf0220d92adaad7, user_id=8efe37a6d57b4775b4e47a295c3f5eee, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.542083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.646287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1218/2418] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:11:16 2022] PUT /identity/v3/projects/69b2364f40d14160adf0220d92adaad7/users/8efe37a6d57b4775b4e47a295c3f5eee/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:11:16.652053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0dfb-d8ca-4d0d-916b-aaf81a11840a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.652344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0dfb-d8ca-4d0d-916b-aaf81a11840a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.652625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c0dfb-d8ca-4d0d-916b-aaf81a11840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.669925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-760c0dfb-d8ca-4d0d-916b-aaf81a11840a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:16.671135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-760c0dfb-d8ca-4d0d-916b-aaf81a11840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:16.729315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1201/2419] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:16.738851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:16.740594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:16.801160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae32a6-2c65-4e4a-a54b-c289dfa159d8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:16.805615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:16.806305 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:16.806594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:16.806875 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:16.816733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:16.818232 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:16.827842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1219/2420] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:11:22.357173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31549-718c-4076-ad9c-c4fbc9719a9c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:22.357723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31549-718c-4076-ad9c-c4fbc9719a9c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:22.357723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31549-718c-4076-ad9c-c4fbc9719a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:22.390896 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-47e31549-718c-4076-ad9c-c4fbc9719a9c None None] MFA Rules not processed for user `8efe37a6d57b4775b4e47a295c3f5eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:22.392167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-47e31549-718c-4076-ad9c-c4fbc9719a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:22.474379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1202/2421] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:22.489436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:22.490912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:22.566667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a970-1b57-4645-bd81-14a3f358c426 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:22.572698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:22.573398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:22.573683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:22.574059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:22.580320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:22.582990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:22.585133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:22.595466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1220/2422] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:11:25.235909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:25.236392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:25.236489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:25.262149 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] MFA Rules not processed for user `8efe37a6d57b4775b4e47a295c3f5eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:25.263827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:25.292268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1203/2423] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:25.616145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:25.625823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eb32b-dda0-4500-ade3-7d0f54f78895 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:25.629563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:25.630301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:25.630596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:25.630865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:25.633311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:25.643740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:25.645277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a6236-1a7e-44bf-b2c4-4c428abd43a5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:25.654264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1221/2424] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:11:35.253539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:35.650593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:38.701166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:11:38.702702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:38.781325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52031e-d766-4507-8c97-54d4203c4880 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:11:38.787325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:11:38.796502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:38.796502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:38.796502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:38.796502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:38.807940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:11:38.809650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f971-e0ce-45db-afa0-5f3f03b0e9a2 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:11:38.821525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1204/2425] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:11:40.788685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:11:40.789577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:11:40.789859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:11:40.809229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] MFA Rules not processed for user `546cd066c4244bffacbfea21f5e4f437`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:11:40.810651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:11:40.867730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1222/2426] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:11:48.816690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=32 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:11:50.860996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=25 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:11.790496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d261-9cb3-4eb3-968e-b247a9ddc038 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:11.790999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d261-9cb3-4eb3-968e-b247a9ddc038 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:11.791092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3d261-9cb3-4eb3-968e-b247a9ddc038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:11.810482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-faf3d261-9cb3-4eb3-968e-b247a9ddc038 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:12:11.811726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-faf3d261-9cb3-4eb3-968e-b247a9ddc038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:12:11.867892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1205/2427] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:12:11.996691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:12:11.998169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:12:12.066471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72340a-560f-495d-890d-aca0c6b59dfb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:12:12.071330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:12:12.072011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:12.072297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:12.072575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:12.081519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:12:12.083326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:12:12.092003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1223/2428] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:12:21.861157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=25 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:22.088070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=32 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:32.304628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7884a-7dbf-4620-a140-b9a5c871e2b6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:32.305113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7884a-7dbf-4620-a140-b9a5c871e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:32.305227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7884a-7dbf-4620-a140-b9a5c871e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:32.322840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-05a7884a-7dbf-4620-a140-b9a5c871e2b6 None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:12:32.324546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-05a7884a-7dbf-4620-a140-b9a5c871e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:12:32.331671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1206/2429] 10.222.0.55 () {58 vars in 1009 bytes} [Tue May 31 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:12:32.344983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:12:32.355487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207001d-0b71-427b-9c9e-2bccfc0795cf service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:12:32.360679 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:12:32.361321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:32.361609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:32.361912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:32.370311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:12:32.371896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:12:32.380155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1224/2430] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:12:42.317605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:42.376701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:12:55.581118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:55.581639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:55.581747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:55.600180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] MFA Rules not processed for user `76746e56fdda493f8e64e66c03fedcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:12:55.601377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:12:55.608471 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1207/2431] 10.222.0.55 () {58 vars in 967 bytes} [Tue May 31 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:12:55.620760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:12:55.631725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea574-a5ee-473c-8fec-71a6c562fea5 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:12:55.636708 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8411904e69324169ad7f8907297f650c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:12:55.637339 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:12:55.637619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:12:55.637909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:12:55.646557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:12:55.648117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae88fc-e3f4-473e-820d-7371a7619646 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:12:55.656034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1225/2432] 10.222.0.55 () {60 vars in 1384 bytes} [Tue May 31 21:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 21:13:05.595403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:05.652822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:20.416591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:20.426812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d270e-2cf8-4a5c-aade-92b85a49dabd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:20.428916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:20.429404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:20.429495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:20.430392 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:20.431671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:20.431955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:20.432229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:20.434009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:20.447501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:20.449126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:20.450218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] MFA Rules not processed for user `8efe37a6d57b4775b4e47a295c3f5eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:20.451551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:20.459636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1226/2433] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:13:20.460524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1208/2434] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:13:20.496081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:20.500724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:20.556133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7ff3-60ec-4338-baeb-48e972490c7b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:20.560454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:20.561185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:20.561471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:20.561748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:20.563815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:20.578313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:20.579756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:20.590956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1227/2435] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:30.057763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:30.066978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f7f01-ba24-4ebe-bd1f-595d2e239977 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:30.070536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:30.071175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:30.071481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:30.071759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:30.073554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:30.085818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:30.087261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:30.096694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1209/2436] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:30.586190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=29 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:33.930723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:33.932314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:33.946983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa16b-c5fb-4923-a564-84f4b21fd392 service glance] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:33.951652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:33.952559 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:33.952866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:33.953145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] PATH_INFO: `/v3/users/92d56ad8d4ab4c1099263a3d1c43490a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:33.967996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d56ad8d4ab4c1099263a3d1c43490a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:33.972613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:34.188169 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d56ad8d4ab4c1099263a3d1c43490a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.206508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d56ad8d4ab4c1099263a3d1c43490a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.207245 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d56ad8d4ab4c1099263a3d1c43490a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.214482 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d56ad8d4ab4c1099263a3d1c43490a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.215149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1b7ed423-807d-44f5-9b61-90a1ffcf7d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d56ad8d4ab4c1099263a3d1c43490a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.301292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1228/2437] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:13:33 2022] DELETE /identity/v3/users/92d56ad8d4ab4c1099263a3d1c43490a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:34.564557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:34.581701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1a1d-8dad-4557-99bf-991ec65f1a7a service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:34.644297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:34.645161 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:34.645450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:34.645727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] PATH_INFO: `/v3/projects/180ff6fd8c5b434abffa058ea99ef7c4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:34.656715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=180ff6fd8c5b434abffa058ea99ef7c4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:34.659158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:34.796243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180ff6fd8c5b434abffa058ea99ef7c4', 'request_id': 'req-3269a456-3000-492d-940a-989f9259b87b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.804367 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180ff6fd8c5b434abffa058ea99ef7c4', 'request_id': 'req-3269a456-3000-492d-940a-989f9259b87b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.810183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180ff6fd8c5b434abffa058ea99ef7c4', 'request_id': 'req-3269a456-3000-492d-940a-989f9259b87b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.899864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] The token cache is being invalidate because project 180ff6fd8c5b434abffa058ea99ef7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:34.900157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.900778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3269a456-3000-492d-940a-989f9259b87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:34.902376 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1210/2438] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:34 2022] DELETE /identity/v3/projects/180ff6fd8c5b434abffa058ea99ef7c4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:34.907292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:34.907525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:34.907811 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:34.927194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:34.932308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:34.988705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1229/2439] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:34.997023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:34.997297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:34.997582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.015889 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:35.017120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:35.025705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1211/2440] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:35.030007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.042034 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eced26-fa6d-4467-94af-61ae61cea712 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.047412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.048068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.048348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.048647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.049387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:13:35.049692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.051327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.063490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1230/2441] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:13:35.067786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.077395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5566-70ae-42f3-a325-14580dfc2a29 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.084086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.085939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.085939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.085939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.086240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.087947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.170812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1212/2442] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:35 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:35.175104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.185701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6147-7af9-4c72-ad7a-85704ee3a2ce admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.232459 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:35.244932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.245626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.245973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.246193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.246974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.248888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.341175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1231/2443] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:35 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:35.345248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.355901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737fa1-860a-40d7-9bd2-5d268feb42bf admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.360659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.361330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.361671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.361971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.362706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.364352 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.376272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1213/2444] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:35.383569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.394290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553be5-007e-43ad-8e38-01f0b11026db admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.398874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.399542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.399893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.400091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.401873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.404659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ad594-a6a5-45ff-8ea2-8b9abd3250ac admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.429118 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1232/2445] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:35.430157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.441020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fdd36-3247-4715-bc16-58d0b9bd73c7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.446433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.447339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.447623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.447902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] PATH_INFO: `/v3/projects/58447e581b494b42adc0304de73c6a57/users/9d73084b43a1403aa98d00ba6a4ca775/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.462833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:35.467035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=58447e581b494b42adc0304de73c6a57, user_id=9d73084b43a1403aa98d00ba6a4ca775, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.468770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.557932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1214/2446] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:35 2022] PUT /identity/v3/projects/58447e581b494b42adc0304de73c6a57/users/9d73084b43a1403aa98d00ba6a4ca775/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:13:35.569589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.570601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.570601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.600566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] MFA Rules not processed for user `9d73084b43a1403aa98d00ba6a4ca775`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:35.602048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:35.674616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1233/2447] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:35.678916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.748958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c704c-4982-45b7-b8c4-bfff121717aa admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.754949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.756116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.756116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.756926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.757299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.759313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:35.839561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1215/2448] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:35 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:35.843669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:35.855567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50afcd0-b7ff-4322-9390-f86198789952 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:35.922391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:35.923733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:35.924715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:35.925594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:35.926443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:35.928909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.036334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1234/2449] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:35 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:36.040228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:36.051827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8da6-7956-4e16-af6c-37479eff0ee1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:36.056434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:36.057244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.057631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.058043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.058789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:36.060476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.072721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1216/2450] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:36.077054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:36.088242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4cd91-5770-44e4-a5ca-1b29e7edaf61 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:36.093312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:36.094243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.094546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.094823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] PATH_INFO: `/v3/projects/b24e09e4470e4623aca7a0b97c33b023/users/7f88f7e2e6b940b1a04d349232db8788/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.114617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24e09e4470e4623aca7a0b97c33b023, user_id=7f88f7e2e6b940b1a04d349232db8788, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:36.117523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.214806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1235/2451] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:36 2022] PUT /identity/v3/projects/b24e09e4470e4623aca7a0b97c33b023/users/7f88f7e2e6b940b1a04d349232db8788/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:36.218824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:36.229574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255eb3e-7cf3-4a00-bdc4-6114adb1330b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:36.288481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:36.289160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.289438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.289709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.290476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:36.292177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87a5be-a006-41f7-a8cf-1de797ffd1f6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.304105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1217/2452] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:36.309325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:36.320279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58b0f-d84e-4390-a445-0953c0caac16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:36.325187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:36.326252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.326537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.326812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] PATH_INFO: `/v3/projects/b24e09e4470e4623aca7a0b97c33b023/users/7f88f7e2e6b940b1a04d349232db8788/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.328855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24e09e4470e4623aca7a0b97c33b023, user_id=7f88f7e2e6b940b1a04d349232db8788, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:36.331902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.343870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1236/2453] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:36 2022] PUT /identity/v3/projects/b24e09e4470e4623aca7a0b97c33b023/users/7f88f7e2e6b940b1a04d349232db8788/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:13:36.364638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.365064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.365455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.392316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] MFA Rules not processed for user `7f88f7e2e6b940b1a04d349232db8788`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:36.393551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:36.446963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:36.469395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1218/2454] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:36.482758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:36.484638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:36.496157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:36.544586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c89ef-e708-4839-bc1e-18ed12b5fa84 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:36.548442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:36.549156 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:36.549441 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:36.549719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:36.559942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:36.561412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:36.571135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1237/2455] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:37.647864 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:37.656983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17459bbe-7884-49c3-90d4-2e3f70743614 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:37.662102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f88f7e2e6b940b1a04d349232db8788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b24e09e4470e4623aca7a0b97c33b023', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:37.662762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:37.663049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:37.663330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:37.664062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:13:37.664374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:37.665994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:37.678165 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1219/2456] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:13:37.682167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:37.691148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c1a5-0224-4012-a186-ec313667f30d service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:37.695664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f88f7e2e6b940b1a04d349232db8788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b24e09e4470e4623aca7a0b97c33b023', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:37.696316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:37.696603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:37.696884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:37.697586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:37.699521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:37.781282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1238/2457] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:37 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:37.785850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:37.796202 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcce39-fd33-4faa-9a3b-b047c91b36f8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:37.852019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f88f7e2e6b940b1a04d349232db8788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b24e09e4470e4623aca7a0b97c33b023', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:37.852626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:37.852916 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:37.853197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:37.853955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:13:37.854299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:37.855894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:37.867699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1220/2458] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:13:37.902673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:37.913461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f640-f81c-4661-9ec8-43fd7975fb96 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:37.918006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f88f7e2e6b940b1a04d349232db8788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b24e09e4470e4623aca7a0b97c33b023', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:37.918862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:37.919147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:37.919426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] PATH_INFO: `/v3/projects/a97907b3507947a88d42cbcc03765dd0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:37.920615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a97907b3507947a88d42cbcc03765dd0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:37.922565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:38.058199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97907b3507947a88d42cbcc03765dd0', 'request_id': 'req-76147e72-309d-4fee-afe4-c864450049d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:38.197227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97907b3507947a88d42cbcc03765dd0', 'request_id': 'req-76147e72-309d-4fee-afe4-c864450049d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:38.204576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97907b3507947a88d42cbcc03765dd0', 'request_id': 'req-76147e72-309d-4fee-afe4-c864450049d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:38.217845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] The token cache is being invalidate because project a97907b3507947a88d42cbcc03765dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:38.218151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:38.218794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-76147e72-309d-4fee-afe4-c864450049d8 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:38.220326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1239/2459] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:37 2022] DELETE /identity/v3/projects/a97907b3507947a88d42cbcc03765dd0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:38.902409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:38.904190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:38.968879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a0c49-3dda-4f2d-b005-380886074de2 tempest-VolumeQuotaClassesTest-975901162 tempest-VolumeQuotaClassesTest-975901162-project-admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:39.024579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:39.025503 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:39.025785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:39.026090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] PATH_INFO: `/v3/users/9d73084b43a1403aa98d00ba6a4ca775` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:39.027298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d73084b43a1403aa98d00ba6a4ca775)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:39.029215 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:39.045304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:39.224674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d73084b43a1403aa98d00ba6a4ca775'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:39.236468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d73084b43a1403aa98d00ba6a4ca775'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:39.237126 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d73084b43a1403aa98d00ba6a4ca775'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:39.244780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d73084b43a1403aa98d00ba6a4ca775'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:39.245399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d73084b43a1403aa98d00ba6a4ca775'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:39.300741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1221/2460] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:13:38 2022] DELETE /identity/v3/users/9d73084b43a1403aa98d00ba6a4ca775 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:39.305697 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:39.306205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:39.306321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:39.323655 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:39.324908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:39.383887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1240/2461] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:39.393450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:39.395432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:39.460435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2be9d2-17ef-45c8-8571-08eb5e26cb28 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:39.464077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:39.464722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:39.465008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:39.465285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:39.474292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:39.475810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:39.485213 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1222/2462] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:39.895660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:39.897103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:39.909106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88a108-5662-47ec-9424-767e79a2cef3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:39.914299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:39.915170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:39.915449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:39.915786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] PATH_INFO: `/v3/projects/58447e581b494b42adc0304de73c6a57` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:39.917004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58447e581b494b42adc0304de73c6a57)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:39.918949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:39.928235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:40.024343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58447e581b494b42adc0304de73c6a57', 'request_id': 'req-24eaa824-d32f-4ab3-bda0-464df670f150'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.116825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58447e581b494b42adc0304de73c6a57', 'request_id': 'req-24eaa824-d32f-4ab3-bda0-464df670f150'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.122797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58447e581b494b42adc0304de73c6a57', 'request_id': 'req-24eaa824-d32f-4ab3-bda0-464df670f150'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.134635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] The token cache is being invalidate because project 58447e581b494b42adc0304de73c6a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:40.135014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.136438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.138024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1241/2463] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:39 2022] DELETE /identity/v3/projects/58447e581b494b42adc0304de73c6a57 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:40.142053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:40.152699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24cf8-fcfe-48fa-a69d-77b3dd60bc0f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:40.209150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:40.210064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:40.210347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:40.210711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] PATH_INFO: `/v3/users/7f88f7e2e6b940b1a04d349232db8788` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:40.211797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f88f7e2e6b940b1a04d349232db8788)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:40.213702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:40.444135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:40.450133 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f88f7e2e6b940b1a04d349232db8788'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.462551 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f88f7e2e6b940b1a04d349232db8788'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.467266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f88f7e2e6b940b1a04d349232db8788'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.470112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f88f7e2e6b940b1a04d349232db8788'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.470768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6a1429e5-4b3f-4dc2-904c-9e58c2d64319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f88f7e2e6b940b1a04d349232db8788'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:40.579442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1223/2464] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:13:40 2022] DELETE /identity/v3/users/7f88f7e2e6b940b1a04d349232db8788 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:41.010470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.011948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:41.025525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa824-d32f-4ab3-bda0-464df670f150 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.083720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.084583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.084871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.085149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] PATH_INFO: `/v3/projects/b24e09e4470e4623aca7a0b97c33b023` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.086370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24e09e4470e4623aca7a0b97c33b023)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.088270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.195700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24e09e4470e4623aca7a0b97c33b023', 'request_id': 'req-ce7db22c-ca89-46e5-8a80-0264b79a2a68'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:41.269299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24e09e4470e4623aca7a0b97c33b023', 'request_id': 'req-ce7db22c-ca89-46e5-8a80-0264b79a2a68'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:41.275649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24e09e4470e4623aca7a0b97c33b023', 'request_id': 'req-ce7db22c-ca89-46e5-8a80-0264b79a2a68'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:41.288806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] The token cache is being invalidate because project b24e09e4470e4623aca7a0b97c33b023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:41.289114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:41.289777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce7db22c-ca89-46e5-8a80-0264b79a2a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:41.291348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1242/2465] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:41 2022] DELETE /identity/v3/projects/b24e09e4470e4623aca7a0b97c33b023 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:41.296269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.296738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.296833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.315730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:41.316943 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:41.375030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1224/2466] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:41.383925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.384319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.384614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.402376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:41.403608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:41.412107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1243/2467] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:41.416304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.426629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad685ae-1aa4-4843-a238-c3c95daecd23 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.431263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.431949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.432230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.432505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.433237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:13:41.433546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.435174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.446817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1225/2468] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:13:41.451077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.460635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906ef93-9d58-4742-8d7b-4d0835cb0eee None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.474038 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.474699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.474983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.475261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.475956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.477914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.596130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:41.603979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1244/2469] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:41 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:41.608388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.619386 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfd588-b55a-4644-95e3-05d81d25f7d8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.685586 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.686292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.686583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.686888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.687579 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.689485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.797714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1226/2470] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:41 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:41.801847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.812094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d425b8-e5d6-450e-a8a9-d349fa70b420 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.816531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.817185 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.817465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.817738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.818495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.820071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.829885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1245/2471] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:41.834570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.844440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eee39-9cf2-45d3-9f4b-a3fa29322dc7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.849709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.850404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.850685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.850961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.851688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.853261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600ed67-877b-4449-a25d-9354327ff25d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.863073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1227/2472] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:41.867077 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:41.876763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b00a-4ff0-41bb-8d61-e73f81d41a54 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:41.881184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:41.882091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.882375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.882649 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] PATH_INFO: `/v3/projects/cf455a3d28db4107b3664b4b947b82e4/users/cff91910f5ed4e07a3cad8a6e828320c/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:41.897261 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf455a3d28db4107b3664b4b947b82e4, user_id=cff91910f5ed4e07a3cad8a6e828320c, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:41.899915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:41.967014 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1246/2473] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:41 2022] PUT /identity/v3/projects/cf455a3d28db4107b3664b4b947b82e4/users/cff91910f5ed4e07a3cad8a6e828320c/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:41.978112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:41.978411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:41.978692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.004497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] MFA Rules not processed for user `cff91910f5ed4e07a3cad8a6e828320c`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:42.005705 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:42.015095 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:42.070982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1228/2474] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:42.075511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.137043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e09e70-47d4-4e27-9785-7f2575aebc4d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.141835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.142535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.142824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.143103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.143874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.146312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.249798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1247/2475] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:42 2022] POST /identity/v3/projects => generated 401 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:42.254464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.266291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cb931-10b4-4178-a982-c36c4e4aee9a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.323539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.324208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.324405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.324684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.325384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.327315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.413467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1229/2476] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:42 2022] POST /identity/v3/users => generated 307 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:42.417295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.428378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dd7cd-0fb7-4a04-bf7d-7dbe305d462d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.433053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.433747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.434072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.434349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.435093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.436706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.448587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1248/2477] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:42.452858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.463285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322995-b71e-48ed-9635-0f14e903151a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.467853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.468763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.469045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.469323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] PATH_INFO: `/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4/users/726e051321a440ee9ab8f4cc98c659e2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.484440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f4aebfae047ab80a9d9cca67fe5a4, user_id=726e051321a440ee9ab8f4cc98c659e2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.487129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.545590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1230/2478] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:42 2022] PUT /identity/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4/users/726e051321a440ee9ab8f4cc98c659e2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:42.549501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.559932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a552a2c-b64a-4874-94cc-b5dc6e63852b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.614770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.615362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.615648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.615929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.616653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.618290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e038b8-a7df-4b15-92d6-0fb02b8ffe74 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.627994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1249/2479] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:42.632745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.643053 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c10f-ebc2-45c0-9320-32bad2223a20 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.647681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.648591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.648872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.649148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] PATH_INFO: `/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4/users/726e051321a440ee9ab8f4cc98c659e2/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.651124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f4aebfae047ab80a9d9cca67fe5a4, user_id=726e051321a440ee9ab8f4cc98c659e2, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.653755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.664276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1231/2480] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:42 2022] PUT /identity/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4/users/726e051321a440ee9ab8f4cc98c659e2/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:42.676064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.676357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.676641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.702837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] MFA Rules not processed for user `726e051321a440ee9ab8f4cc98c659e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:42.704050 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:42.723688 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:42.771316 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1250/2481] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:13:42.783176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:42.785512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:42.841954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c6b3-f952-4c33-8ab8-1453378e5f1c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:42.845590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:42.846262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:42.846552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:42.847325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:42.856475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:42.857945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:42.867876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1232/2482] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:43.032936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:43.042924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90bb4-99ac-4cdb-b508-4f25fee7e941 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:43.046424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:43.047124 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:43.047398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:43.047695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:43.105740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:43.107254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db76af-c1bd-41c4-991b-1b371285c490 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:43.116938 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1251/2483] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:48.207987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:48.217276 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:48.270839 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540042f-60d8-4f49-b11a-23e1094e29a2 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:48.275729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:48.276615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:48.276901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:48.277179 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] PATH_INFO: `/v3/users/cff91910f5ed4e07a3cad8a6e828320c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:48.278572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff91910f5ed4e07a3cad8a6e828320c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:48.280502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:48.422983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff91910f5ed4e07a3cad8a6e828320c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:48.434986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff91910f5ed4e07a3cad8a6e828320c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:48.435712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff91910f5ed4e07a3cad8a6e828320c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:48.442694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff91910f5ed4e07a3cad8a6e828320c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:48.443348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff91910f5ed4e07a3cad8a6e828320c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:48.523191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1233/2484] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:13:48 2022] DELETE /identity/v3/users/cff91910f5ed4e07a3cad8a6e828320c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:48.527682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:48.528200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:48.528312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:48.546588 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:48.547793 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:48.609361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1252/2485] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:48.618902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:48.623759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:48.688566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040400-d2a0-4fc3-bfa5-7697a4962577 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:48.693549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:48.694232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:48.694512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:48.694787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:48.703796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:48.705209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:48.715312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1234/2486] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:49.122464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:49.123941 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:49.137273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645aa1-7ec2-45d7-b154-ca1d8dd7a5d7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:49.142186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:49.142950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:49.143238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:49.143521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] PATH_INFO: `/v3/projects/cf455a3d28db4107b3664b4b947b82e4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:49.145360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf455a3d28db4107b3664b4b947b82e4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:49.147650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:49.253328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf455a3d28db4107b3664b4b947b82e4', 'request_id': 'req-b8d0f2ac-4283-4d55-8349-ec078e4f3203'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.256365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:49.348995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf455a3d28db4107b3664b4b947b82e4', 'request_id': 'req-b8d0f2ac-4283-4d55-8349-ec078e4f3203'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.355577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf455a3d28db4107b3664b4b947b82e4', 'request_id': 'req-b8d0f2ac-4283-4d55-8349-ec078e4f3203'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.367217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] The token cache is being invalidate because project cf455a3d28db4107b3664b4b947b82e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:49.367504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.368149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.369823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1253/2487] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:49 2022] DELETE /identity/v3/projects/cf455a3d28db4107b3664b4b947b82e4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:49.373856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:49.384160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d84a7-4eba-47f0-90cf-85c9db9735de service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:49.409987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:49.440230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:49.441248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:49.442075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:49.442353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] PATH_INFO: `/v3/users/726e051321a440ee9ab8f4cc98c659e2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:49.443655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726e051321a440ee9ab8f4cc98c659e2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:49.445617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:49.599830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726e051321a440ee9ab8f4cc98c659e2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.611906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726e051321a440ee9ab8f4cc98c659e2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.612573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726e051321a440ee9ab8f4cc98c659e2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.620316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726e051321a440ee9ab8f4cc98c659e2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.620951 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69f3b4a2-0fa4-4825-a8b4-7030668eefb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726e051321a440ee9ab8f4cc98c659e2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:49.704351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1235/2488] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:13:49 2022] DELETE /identity/v3/users/726e051321a440ee9ab8f4cc98c659e2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:50.151499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.153093 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:50.169973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0f2ac-4283-4d55-8349-ec078e4f3203 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.228455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.229331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.229617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.229922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] PATH_INFO: `/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.231101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40f4aebfae047ab80a9d9cca67fe5a4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.233078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.352601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40f4aebfae047ab80a9d9cca67fe5a4', 'request_id': 'req-a5359aba-7a97-4c3e-953e-59c6d698c7e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:50.436903 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40f4aebfae047ab80a9d9cca67fe5a4', 'request_id': 'req-a5359aba-7a97-4c3e-953e-59c6d698c7e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:50.443831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40f4aebfae047ab80a9d9cca67fe5a4', 'request_id': 'req-a5359aba-7a97-4c3e-953e-59c6d698c7e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:50.457182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] The token cache is being invalidate because project a40f4aebfae047ab80a9d9cca67fe5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:13:50.457463 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:50.458146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a5359aba-7a97-4c3e-953e-59c6d698c7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:13:50.459867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1254/2489] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:13:50 2022] DELETE /identity/v3/projects/a40f4aebfae047ab80a9d9cca67fe5a4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:50.465113 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.465600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.465722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.485390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:50.486663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:50.545554 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1236/2490] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:50.554133 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.554428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.554711 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.574507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:50.575713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:50.583982 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1255/2491] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:50.588194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.598674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda34fce-2bb7-45d5-9f47-c7fdf23e1ae3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.603457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.604116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.604397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.604670 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.605449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:13:50.605750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.607415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.619965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1237/2492] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:13:50.624375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.634073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a424a8-be5e-4e81-9aab-1a779efa6dc0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.638885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.639628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.639906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.640180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.640868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.642787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.726311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1256/2493] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:50 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:50.730461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.741888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c292d-d6d2-41d4-bdd3-8dd2e4fb85d7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.775359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:50.800528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.801211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.801496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.801776 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.802516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.804454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.903082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1238/2494] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:50 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:50.907236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.917926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa6c5-12e7-42a1-8b54-5a718f78fb2a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.922446 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.923109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.923395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.923739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.924422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.926104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.936535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1257/2495] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:50.940449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.950967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0bb3-08b8-4753-8856-a90121737208 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.955546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.956463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.957259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.957534 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:50.958292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:50.959906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1af8fd-05b0-4d13-94a6-f0aa24925bb7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:50.969730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1239/2496] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:50.974470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:50.984363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17afea-d37d-4362-96c8-9c8b2da26965 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:50.988949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:50.989830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:50.990213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:50.990495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] PATH_INFO: `/v3/projects/4bf6a067306e4a908427a81f761462bd/users/996625f955eb4652a4f17dbd942fb304/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.005466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf6a067306e4a908427a81f761462bd, user_id=996625f955eb4652a4f17dbd942fb304, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.008126 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.122854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1258/2497] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:50 2022] PUT /identity/v3/projects/4bf6a067306e4a908427a81f761462bd/users/996625f955eb4652a4f17dbd942fb304/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:51.133687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.135851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.135851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.161648 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] MFA Rules not processed for user `996625f955eb4652a4f17dbd942fb304`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:51.162875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:51.226124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1240/2498] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:51.230636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.239713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:51.297829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540ccd-56fc-4745-9034-c562cecf9652 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.303020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.303717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.304001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.304281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.304987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.307183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.422102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1259/2499] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:51 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:51.426676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.437287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5999b-1235-45e1-8b61-a22559d8ec20 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.493142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.493920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.494089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.494373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.495076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.496993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.619340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1241/2500] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:51 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:13:51.623427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.637180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cd429-911e-4861-bdac-1c100d7cace1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.638888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.639550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.639830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.640103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.640870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.642474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.653155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1260/2501] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:51.657557 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.667898 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e448b-fc37-4f15-b6d6-3d9a81bf5f3e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.672787 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.673469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.673757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.674082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.674826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.677016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7de566-ac4c-4aa7-99c5-20e8953524f6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.687642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1242/2502] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:51.692412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.704379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09cc1f-9911-40d0-9b67-3f9212daf5c8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.709437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.710365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.710648 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.710929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] PATH_INFO: `/v3/projects/26e4cefd859747b9bc2b7e3a55a33c85/users/1a475e20ef9a4028973f2eb19ec0c7bb/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.726273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e4cefd859747b9bc2b7e3a55a33c85, user_id=1a475e20ef9a4028973f2eb19ec0c7bb, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.728936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:51.792994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1261/2503] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:51 2022] PUT /identity/v3/projects/26e4cefd859747b9bc2b7e3a55a33c85/users/1a475e20ef9a4028973f2eb19ec0c7bb/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:51.805250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.805539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.805812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.832456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] MFA Rules not processed for user `1a475e20ef9a4028973f2eb19ec0c7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:51.833651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:51.842820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:51.896809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1243/2504] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:51.901322 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:51.962619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184568f-9fcb-402b-b742-c2f20e2f4370 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:51.967088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:51.967744 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:51.968024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:51.968297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:51.968993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:51.970946 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.076218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1262/2505] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:13:51 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:52.080206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.090931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f37c-56a7-45fb-8587-1e55c2260914 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.149284 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.149986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.150270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.150546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.151228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.153248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.246732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1244/2506] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:13:52 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:13:52.250767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.261024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93b94a-ad4b-4a8a-bb27-d52d7c3ec954 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.265643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.266342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.266632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.266914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.267639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.269798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.280991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1263/2507] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:52.286072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.296865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9b144-dfa1-4730-aba1-70ccdb4354ab admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.301802 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.302737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.303025 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.303380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] PATH_INFO: `/v3/projects/2f5e014553164a36a77fe5325e15a0e3/users/54cda46ba3d845ee9495d23f067a0d71/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.318874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5e014553164a36a77fe5325e15a0e3, user_id=54cda46ba3d845ee9495d23f067a0d71, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.321593 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.403228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1245/2508] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:52 2022] PUT /identity/v3/projects/2f5e014553164a36a77fe5325e15a0e3/users/54cda46ba3d845ee9495d23f067a0d71/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:52.407272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.417867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef88b5-3c92-4198-97ed-e1302e144214 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.446678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:52.475134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.475815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.476300 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.476805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.477572 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.479623 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc8ca3-19fd-4a1e-8578-5af03280d9df admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.489635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1264/2509] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:13:52.494020 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.504932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9085f-3ee4-4abc-b576-70a85adfbd35 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.509504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.510407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.510716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.510984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] PATH_INFO: `/v3/projects/2f5e014553164a36a77fe5325e15a0e3/users/54cda46ba3d845ee9495d23f067a0d71/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.512930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5e014553164a36a77fe5325e15a0e3, user_id=54cda46ba3d845ee9495d23f067a0d71, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.515599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.527016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1246/2510] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:13:52 2022] PUT /identity/v3/projects/2f5e014553164a36a77fe5325e15a0e3/users/54cda46ba3d845ee9495d23f067a0d71/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:13:52.537274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.540756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.540756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.563767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] MFA Rules not processed for user `54cda46ba3d845ee9495d23f067a0d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:13:52.564985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:52.631406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1265/2511] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:13:52.642629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.644991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:52.701073 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef255-4bf3-4c4c-926f-1a1b4963d985 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.704706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.705347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.705627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.706195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.715683 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.717093 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.726444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1247/2512] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:52.826527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:52.828195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:52.840957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ea64c-f9bd-4c20-bfaf-627c4b4e0b37 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:52.844472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:52.845114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:52.845398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:52.845676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:52.903010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:52.904107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:52.913027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1266/2513] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:53.578030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:53.595438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec080466-575e-4c18-b1d8-77ef63cd1c09 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:53.598960 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:53.599603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:53.599882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:53.600157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:53.602042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:53.604552 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:53.684946 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:53.686425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:53.706048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1248/2514] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:13:54.404468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:13:54.413184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66951fad-dcee-4284-a61b-19c34fac450d service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:13:54.416738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:13:54.417375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:13:54.417713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:13:54.418033 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:13:54.419912 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:13:54.468525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:13:54.479350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:13:54.480876 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fc354-9632-44ca-8afd-2d3a0723c64b service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:13:54.490324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1267/2515] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:01.033542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:01.101989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c296e-61c3-4fd0-8154-8894e37b7376 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:01.110377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:01.111293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:01.111572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:01.111843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] PATH_INFO: `/v3/users/996625f955eb4652a4f17dbd942fb304` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:01.113647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996625f955eb4652a4f17dbd942fb304)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:01.115885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:01.292092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996625f955eb4652a4f17dbd942fb304'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:01.304089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996625f955eb4652a4f17dbd942fb304'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:01.305048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996625f955eb4652a4f17dbd942fb304'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:01.313858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996625f955eb4652a4f17dbd942fb304'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:01.314644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996625f955eb4652a4f17dbd942fb304'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:01.320324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:01.421330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1249/2516] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:01 2022] DELETE /identity/v3/users/996625f955eb4652a4f17dbd942fb304 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:01.426181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:01.426712 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:01.426821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:01.452620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:01.454071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:01.520053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1268/2517] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:01.529325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:01.530881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:01.599893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855c9b8-a72d-4cf0-8377-8dbc73c43fa5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:01.603499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:01.604152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:01.604437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:01.604714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:01.614543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:01.615978 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:01.625807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1250/2518] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:02.032342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:02.034011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:02.047318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75ab7d-0007-46f6-8a46-fc3d3d6dfd75 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:02.052132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:02.053233 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:02.053518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:02.053795 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] PATH_INFO: `/v3/projects/4bf6a067306e4a908427a81f761462bd` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:02.055045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf6a067306e4a908427a81f761462bd)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:02.056984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:02.156294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf6a067306e4a908427a81f761462bd', 'request_id': 'req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.218990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf6a067306e4a908427a81f761462bd', 'request_id': 'req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.226676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf6a067306e4a908427a81f761462bd', 'request_id': 'req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.237976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] The token cache is being invalidate because project 4bf6a067306e4a908427a81f761462bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:02.238268 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.239043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.240557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1269/2519] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:02 2022] DELETE /identity/v3/projects/4bf6a067306e4a908427a81f761462bd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:02.244565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:02.254731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12787f-4d55-4eea-9113-54c252fd9e94 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:02.310559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:02.311434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:02.311718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:02.311994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] PATH_INFO: `/v3/users/1a475e20ef9a4028973f2eb19ec0c7bb` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:02.313172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a475e20ef9a4028973f2eb19ec0c7bb)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:02.315111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:02.513639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a475e20ef9a4028973f2eb19ec0c7bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.527474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a475e20ef9a4028973f2eb19ec0c7bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.528181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a475e20ef9a4028973f2eb19ec0c7bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.535676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a475e20ef9a4028973f2eb19ec0c7bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.541602 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a475e20ef9a4028973f2eb19ec0c7bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:02.625717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1251/2520] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:02 2022] DELETE /identity/v3/users/1a475e20ef9a4028973f2eb19ec0c7bb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:03.088976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:03.090689 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:03.106242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405150c5-d7fc-4d2d-8c9e-6d451803ffe8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:03.166380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:03.167258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:03.167539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:03.167816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] PATH_INFO: `/v3/projects/26e4cefd859747b9bc2b7e3a55a33c85` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:03.169010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e4cefd859747b9bc2b7e3a55a33c85)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:03.170979 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:03.188664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:03.316667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e4cefd859747b9bc2b7e3a55a33c85', 'request_id': 'req-6469cfd0-fc07-48e4-a697-3be10d780e65'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.436383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e4cefd859747b9bc2b7e3a55a33c85', 'request_id': 'req-6469cfd0-fc07-48e4-a697-3be10d780e65'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.443424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e4cefd859747b9bc2b7e3a55a33c85', 'request_id': 'req-6469cfd0-fc07-48e4-a697-3be10d780e65'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.460018 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] The token cache is being invalidate because project 26e4cefd859747b9bc2b7e3a55a33c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:03.460403 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.460935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.462529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1270/2521] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:03 2022] DELETE /identity/v3/projects/26e4cefd859747b9bc2b7e3a55a33c85 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:03.466533 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:03.468212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:03.485057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3cd29-946d-4c33-93f0-d304dd8a5f52 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:03.494522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:03.538651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:03.539523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:03.539806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:03.540079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] PATH_INFO: `/v3/users/54cda46ba3d845ee9495d23f067a0d71` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:03.541247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54cda46ba3d845ee9495d23f067a0d71)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:03.543188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:03.775150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54cda46ba3d845ee9495d23f067a0d71'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.788532 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54cda46ba3d845ee9495d23f067a0d71'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.789380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54cda46ba3d845ee9495d23f067a0d71'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.805358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54cda46ba3d845ee9495d23f067a0d71'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.805358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8db734cd-fbf0-4b23-a352-1220614cab18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54cda46ba3d845ee9495d23f067a0d71'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:03.875852 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1252/2522] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:03 2022] DELETE /identity/v3/users/54cda46ba3d845ee9495d23f067a0d71 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:04.340297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:04.342002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:04.359597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469cfd0-fc07-48e4-a697-3be10d780e65 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:04.416480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:04.417335 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.417616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.417910 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] PATH_INFO: `/v3/projects/2f5e014553164a36a77fe5325e15a0e3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.419088 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5e014553164a36a77fe5325e15a0e3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:04.420994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:04.521757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5e014553164a36a77fe5325e15a0e3', 'request_id': 'req-722a098d-c44f-4ef7-ae24-1cbda3603472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:04.573069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5e014553164a36a77fe5325e15a0e3', 'request_id': 'req-722a098d-c44f-4ef7-ae24-1cbda3603472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:04.579071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5e014553164a36a77fe5325e15a0e3', 'request_id': 'req-722a098d-c44f-4ef7-ae24-1cbda3603472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:04.590560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] The token cache is being invalidate because project 2f5e014553164a36a77fe5325e15a0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:04.590786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:04.591419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-722a098d-c44f-4ef7-ae24-1cbda3603472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:04.593244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1271/2523] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:04 2022] DELETE /identity/v3/projects/2f5e014553164a36a77fe5325e15a0e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:04.599616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.600099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.600271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.620861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:04.622174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:04.680899 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1253/2524] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:04.689616 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.689913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.690190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.708333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:04.709540 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:04.717700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1272/2525] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:04.722706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:04.732384 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bded6d-809b-434e-81ba-822be9279e2d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:04.737099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:04.738361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.738646 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.738919 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.739644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:04.739948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:04.741512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:04.753496 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1254/2526] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:04.758109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:04.767593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2182b51-a730-45c0-ac64-8d7d1f5a6cc9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:04.772194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:04.772873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.773155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.773432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.774162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:04.776063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:04.872172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1273/2527] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:04 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:04.876356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:04.886748 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e6ef4-2bee-4661-be3f-8d532f13e3cc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:04.907495 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:04.943625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:04.944610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:04.944941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:04.945223 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:04.945921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:04.947851 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.070014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1255/2528] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:04 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:05.074094 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.080916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:05.084986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647091-ef4f-4eb0-9be0-ae9af6ad2486 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.089667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.090387 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.090673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.090952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.091687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.093348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.104318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1274/2529] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:05.121000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.131615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d8cac-d705-40e3-8ed3-d3cc6933478e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.136110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.136760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.137041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.137316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.138076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.139661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1dbfc-d15c-4fc9-b587-9184e3c2a0ad admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.150116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1256/2530] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:05.154011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.164877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b84cb-a655-4e49-b7e4-fba1deff6ab6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.169479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.170434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.170719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.171001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] PATH_INFO: `/v3/projects/64a8fa3a8c4c4d47a898bb0b3f5662f7/users/b6f44635db1548c8b4b851841cef5a9c/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.185241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a8fa3a8c4c4d47a898bb0b3f5662f7, user_id=b6f44635db1548c8b4b851841cef5a9c, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.187969 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.246443 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1275/2531] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:05 2022] PUT /identity/v3/projects/64a8fa3a8c4c4d47a898bb0b3f5662f7/users/b6f44635db1548c8b4b851841cef5a9c/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:05.259183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.259499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.259782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.287180 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] MFA Rules not processed for user `b6f44635db1548c8b4b851841cef5a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:05.288391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:05.351980 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1257/2532] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:05.356534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.417438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110600e-e3c9-4052-a97a-3e7452c099f5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.422570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.423241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.423523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.423799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.424620 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.427181 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.518178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1276/2533] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:05 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:05.522378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.533914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a7ee-13de-47d5-b266-2541c5c44da9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.590314 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.590990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.591275 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.591555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.592243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.594411 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.743830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1258/2534] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:05 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:05.748056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.758401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338911dd-663f-4201-80b2-d5450b657734 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.763550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.766786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.766786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.766786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.766786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.767473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.779891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1277/2535] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:05.784298 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.801659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35008e-4b3c-4414-817a-ce47e26c76aa admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.807042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.807949 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.808258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.808536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] PATH_INFO: `/v3/projects/a46d92da18a9419f930b0a751020d5a0/users/adca518661674024bccfafe698ae893c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.824074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46d92da18a9419f930b0a751020d5a0, user_id=adca518661674024bccfafe698ae893c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.826758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.901718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:05.908350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1259/2536] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:05 2022] PUT /identity/v3/projects/a46d92da18a9419f930b0a751020d5a0/users/adca518661674024bccfafe698ae893c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:05.913090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:05.923221 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43477b6d-21ba-4f42-8a2a-0882ac17b7b7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:05.981013 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:05.982069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:05.982366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:05.982690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:05.983433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:05.985065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19590b-74a8-4c43-ad7e-8b8e04e60136 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:05.995578 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1278/2537] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:05.999811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:06.010874 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b860-5c20-4b10-8c5d-e4393e069f94 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:06.015493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:06.016385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:06.016675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:06.016944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] PATH_INFO: `/v3/projects/a46d92da18a9419f930b0a751020d5a0/users/adca518661674024bccfafe698ae893c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:06.019583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46d92da18a9419f930b0a751020d5a0, user_id=adca518661674024bccfafe698ae893c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:06.022250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d8c1c-39ae-4ba9-b65b-e475604590aa admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:06.032445 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1260/2538] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:05 2022] PUT /identity/v3/projects/a46d92da18a9419f930b0a751020d5a0/users/adca518661674024bccfafe698ae893c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:06.043431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:06.043431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:06.043431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:06.071109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] MFA Rules not processed for user `adca518661674024bccfafe698ae893c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:06.072326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:06.107815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:06.159401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1279/2539] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:06.160259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:06.162458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:06.162458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:06.170548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:06.174805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:06.179844 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] MFA Rules not processed for user `546cd066c4244bffacbfea21f5e4f437`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:06.181101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:06.233710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770b69-e4ab-4e9d-9ceb-cec01cc85abe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:06.237543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:06.238222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:06.238505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:06.238786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:06.239048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1261/2540] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:06.249269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:06.250933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b61aa-5345-435f-baff-4f3c275d7bae service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:06.263266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1280/2541] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:06.770308 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:06.840415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123d05-f299-4086-829f-8fa5033f0383 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:06.844913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:06.845792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:06.846098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:06.846399 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] PATH_INFO: `/v3/users/b6f44635db1548c8b4b851841cef5a9c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:06.848115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f44635db1548c8b4b851841cef5a9c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:06.850032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:07.021092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f44635db1548c8b4b851841cef5a9c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:07.032836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f44635db1548c8b4b851841cef5a9c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:07.033615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f44635db1548c8b4b851841cef5a9c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:07.041169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f44635db1548c8b4b851841cef5a9c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:07.042285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f44635db1548c8b4b851841cef5a9c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:07.121876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1262/2542] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:06 2022] DELETE /identity/v3/users/b6f44635db1548c8b4b851841cef5a9c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:07.126430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:07.126883 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:07.127009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:07.145024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:07.146272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.209437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1281/2543] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:07.219948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:07.221549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.241493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:07.243853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:07.245680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.288212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145a68-4c15-472f-b63d-5383301e0efb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:07.294759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:07.295512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:07.295914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:07.296278 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:07.309120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:07.310741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:07.323983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1263/2544] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:07.325282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:07.326939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.334695 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650b3f-e16a-4c8a-9a91-8d31f39a6017 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:07.339383 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:07.340117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:07.340437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:07.340638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:07.343534 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.357756 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:07.359926 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:07.379410 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1282/2545] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:07.408293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba75a06-7091-4c05-a8a4-ad6221b88351 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:07.414207 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:07.414940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:07.415229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:07.415519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:07.417361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.430173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:07.432026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:07.443708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1264/2546] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:07.884980 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:07.886554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:07.910672 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d180-46d7-47a9-be78-7a2592b9e8ae service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:07.915884 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:07.917058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:07.917182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:07.917586 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] PATH_INFO: `/v3/projects/64a8fa3a8c4c4d47a898bb0b3f5662f7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:07.918948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a8fa3a8c4c4d47a898bb0b3f5662f7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:07.921231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:07.929108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:08.076881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a8fa3a8c4c4d47a898bb0b3f5662f7', 'request_id': 'req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.145553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a8fa3a8c4c4d47a898bb0b3f5662f7', 'request_id': 'req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.152086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a8fa3a8c4c4d47a898bb0b3f5662f7', 'request_id': 'req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.164023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] The token cache is being invalidate because project 64a8fa3a8c4c4d47a898bb0b3f5662f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:08.164312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.164978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.166828 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1283/2547] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:07 2022] DELETE /identity/v3/projects/64a8fa3a8c4c4d47a898bb0b3f5662f7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:08.170674 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:08.181262 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4b5dd-3b96-4013-80b5-1596c9994293 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:08.239448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:08.240362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:08.240760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:08.240909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] PATH_INFO: `/v3/users/adca518661674024bccfafe698ae893c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:08.242178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adca518661674024bccfafe698ae893c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:08.244148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:08.426391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:08.431935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adca518661674024bccfafe698ae893c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.468688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adca518661674024bccfafe698ae893c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.469494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adca518661674024bccfafe698ae893c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.478709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adca518661674024bccfafe698ae893c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.479576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d10029e2-fa90-4e66-8956-7209bebcb94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adca518661674024bccfafe698ae893c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:08.576746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1265/2548] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:08 2022] DELETE /identity/v3/users/adca518661674024bccfafe698ae893c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:09.102263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:09.104731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:09.124220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b6af7-23aa-4e0e-a2c6-b89e434d8e2a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:09.190642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:09.191432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.191742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.191993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] PATH_INFO: `/v3/projects/a46d92da18a9419f930b0a751020d5a0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.193220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46d92da18a9419f930b0a751020d5a0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:09.195420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:09.348493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46d92da18a9419f930b0a751020d5a0', 'request_id': 'req-54c2a429-d247-416b-b245-2c7841bf0dc0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:09.442755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46d92da18a9419f930b0a751020d5a0', 'request_id': 'req-54c2a429-d247-416b-b245-2c7841bf0dc0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:09.451654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46d92da18a9419f930b0a751020d5a0', 'request_id': 'req-54c2a429-d247-416b-b245-2c7841bf0dc0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:09.466543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] The token cache is being invalidate because project a46d92da18a9419f930b0a751020d5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:09.466994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:09.467675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54c2a429-d247-416b-b245-2c7841bf0dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:09.473378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1284/2549] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:09 2022] DELETE /identity/v3/projects/a46d92da18a9419f930b0a751020d5a0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:09.474910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.479330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.479330 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.501390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:09.508606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:09.597972 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1266/2550] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:09.606759 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.607049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.607333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.637580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:09.640283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:09.656368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1285/2551] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:09.665012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:09.675814 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f31a82-d122-4f68-9d0c-8abd66525740 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:09.680465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:09.681140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.681424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.681702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.682476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:09.682786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:09.684380 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:09.696591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1267/2552] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:09.700847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:09.711075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c05a-16ca-4c40-9231-9759238ab5de None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:09.716597 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:09.717264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.717599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.717887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.718606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:09.720607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:09.736165 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:09.831064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1286/2553] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:09 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:09.835214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:09.848289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c835f1-c67d-45e5-b310-748b0f4e6206 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:09.940484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:09.941250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:09.943650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:09.948945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:09.948945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:09.948945 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.032237 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1268/2554] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:09 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:10.036781 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:10.047199 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e499c-e29f-44c7-b3a2-9b821a95510f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:10.052581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:10.053271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.053560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.053842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.054634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:10.056248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.067121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1287/2555] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:10.074879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:10.086645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5354598-c935-4018-9524-7ec829a395c2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:10.091506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:10.092609 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.092907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.093544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.093987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:10.095555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e277bd4-f6ac-47cf-9986-5ef07f78010f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.106519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1269/2556] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:10.115208 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:10.125425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e9a5-8293-4212-9823-6fdffdab081e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:10.130378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:10.131414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.131682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.131959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] PATH_INFO: `/v3/projects/c63011eaeb4b4518abe31327ab86e44e/users/adf27fa464954c0dafe8275e59fee149/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.147956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63011eaeb4b4518abe31327ab86e44e, user_id=adf27fa464954c0dafe8275e59fee149, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:10.150664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.235893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1288/2557] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:10 2022] PUT /identity/v3/projects/c63011eaeb4b4518abe31327ab86e44e/users/adf27fa464954c0dafe8275e59fee149/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:10.246286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.246581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.246894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.276266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] MFA Rules not processed for user `adf27fa464954c0dafe8275e59fee149`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:10.277873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:10.294402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:10.374066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1270/2558] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:10.390019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:10.391741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:10.474601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd965a9-c3cd-4341-b4c4-c825a536ef07 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:10.479643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:10.481533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.481830 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.482192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.495800 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:10.497311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.515070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1289/2559] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:10.589565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:10.591915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:10.730489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fc1f3-2667-4904-83b0-9af9a8a2f939 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:10.732651 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:10.733657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:10.734458 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:10.734915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:10.737618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:10.774809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:10.779391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:10.826778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1271/2560] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:11.526753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:11.527584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:11.615371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f43824-abf8-4270-ac62-0b67d1449e1d service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:11.620145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:11.621140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:11.621425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:11.621702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] PATH_INFO: `/v3/users/2d69edafe80649d4aff602b692e294c8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:11.622976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d69edafe80649d4aff602b692e294c8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:11.625009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:11.849487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d69edafe80649d4aff602b692e294c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:11.865507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d69edafe80649d4aff602b692e294c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:11.866562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d69edafe80649d4aff602b692e294c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:11.868148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:11.888123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d69edafe80649d4aff602b692e294c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:11.889024 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34346959-b895-48c5-afb5-29010736d1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d69edafe80649d4aff602b692e294c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:11.943810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1290/2561] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:11 2022] DELETE /identity/v3/users/2d69edafe80649d4aff602b692e294c8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:12.278986 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:12.293378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a52c-3809-4136-93a5-564fe63893a3 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:12.363064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:12.363953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.364240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.364519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] PATH_INFO: `/v3/projects/af420d43367c42e4a4b0948706dd0546` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.365800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af420d43367c42e4a4b0948706dd0546)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:12.367721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:12.478168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af420d43367c42e4a4b0948706dd0546', 'request_id': 'req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:12.484691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af420d43367c42e4a4b0948706dd0546', 'request_id': 'req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:12.490523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:12.491432 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af420d43367c42e4a4b0948706dd0546', 'request_id': 'req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:12.585752 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] The token cache is being invalidate because project af420d43367c42e4a4b0948706dd0546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:12.586102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:12.586738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e71054f-6d8a-40b6-ae8f-a9bb723c37d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:12.588326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1272/2562] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:12 2022] DELETE /identity/v3/projects/af420d43367c42e4a4b0948706dd0546 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:12.593161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.593626 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.593743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.612625 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:12.613974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:12.683836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1291/2563] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:12.692243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.692517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.692794 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.716257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:12.717482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:12.726817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1273/2564] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:12.731243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:12.741148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f825904-f3f5-49b5-80e5-84a96514d693 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:12.746237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:12.746901 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.752891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.752891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.752891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:12.752891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:12.752891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:12.762934 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1292/2565] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:12.767227 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:12.776849 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a8cc-3627-4e05-b7ff-e4990747da15 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:12.781480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:12.782174 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.782462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.782738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.783440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:12.785378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:12.895772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1274/2566] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:12 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:12.899774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:12.910120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0326e6-9c75-4ecf-93d4-0cd652d9e6be admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:12.967393 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:12.968073 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:12.968380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:12.968656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:12.969375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:12.971312 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.071707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1293/2567] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:12 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:13.075858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.087293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7787-3cd8-41df-8966-12732ac5c395 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.092177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.092872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.093158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.093437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.094209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.095857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.106718 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1275/2568] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:13.110874 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.120851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e58c-3a70-4715-99dc-4bb24c5afb7a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.125466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.126151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.126437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.126716 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.127475 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.129698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dd879-aabb-4df4-a590-25da3d4bf0a3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.139698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1294/2569] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:13.144347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.154416 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15fe4-9499-4a89-ae8a-e34ab08aaf8f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.159242 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.160159 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.160440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.160930 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] PATH_INFO: `/v3/projects/29a683469cf44314ad425955b2e125b8/users/89c86385f234457ab8be15803fea65c9/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.176798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a683469cf44314ad425955b2e125b8, user_id=89c86385f234457ab8be15803fea65c9, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.179644 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.247767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1276/2570] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:13 2022] PUT /identity/v3/projects/29a683469cf44314ad425955b2e125b8/users/89c86385f234457ab8be15803fea65c9/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:13.258842 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.259365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.259746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.294644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] MFA Rules not processed for user `89c86385f234457ab8be15803fea65c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:13.296020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:13.337064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:13.369740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1295/2571] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:13.374354 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.459984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703990d1-11af-4323-b08f-e14605e39f69 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.465362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.466429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.466714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.466989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.467728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.469842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.572661 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1277/2572] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:13 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:13.573966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.584993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa36f7e-772f-4174-be46-3f42f30be73e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.640933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.641591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.641880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.642168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.642848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.644783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.745499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1296/2573] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:13 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:13.749773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.760105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa8f8-6eec-4659-a30f-05f8ca9e7d6f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.764733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.765396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.765688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.765996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.766734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.772189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.779478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1278/2574] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:13.788745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.803635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7bef-0cb5-415d-a278-46227915a079 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.808889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.810011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.810263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.810608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] PATH_INFO: `/v3/projects/00dd09113f154134bd0a5ad000297553/users/4230401e398849f5868c8c65d86a5f25/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.826552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dd09113f154134bd0a5ad000297553, user_id=4230401e398849f5868c8c65d86a5f25, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.829301 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.915308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1297/2575] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:13 2022] PUT /identity/v3/projects/00dd09113f154134bd0a5ad000297553/users/4230401e398849f5868c8c65d86a5f25/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:13.919280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:13.929398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dcb8-1573-40f0-860e-9ddf7b4bc82d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:13.987407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:13.988078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:13.988438 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:13.988766 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:13.989567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:13.991194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaaa60-e4a1-4ee2-9c19-f3f64dbbb6f5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:13.992443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:14.001692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1279/2576] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:14.006081 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:14.016678 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc58c76-6b60-42cc-8c19-1d2cf7b4d1e2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:14.021881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:14.022789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:14.023070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:14.023388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] PATH_INFO: `/v3/projects/00dd09113f154134bd0a5ad000297553/users/4230401e398849f5868c8c65d86a5f25/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:14.025354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dd09113f154134bd0a5ad000297553, user_id=4230401e398849f5868c8c65d86a5f25, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:14.027995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:14.039529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1298/2577] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:14 2022] PUT /identity/v3/projects/00dd09113f154134bd0a5ad000297553/users/4230401e398849f5868c8c65d86a5f25/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:14.050633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:14.050929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:14.051210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:14.078781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] MFA Rules not processed for user `4230401e398849f5868c8c65d86a5f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:14.080006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:14.149050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1280/2578] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:14.161727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:14.163479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:14.224569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf7e49-7fd3-4c6d-9b7d-f091b08d0b95 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:14.228246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:14.228891 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:14.229173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:14.229528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:14.238794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:14.240218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:14.249873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1299/2579] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:14.849606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:14.851096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:14.916285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432f26-f823-4db1-be22-1c496326c458 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:14.920869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:14.921751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:14.922075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:14.922358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] PATH_INFO: `/v3/users/adf27fa464954c0dafe8275e59fee149` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:14.923769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf27fa464954c0dafe8275e59fee149)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:14.926261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:15.312005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf27fa464954c0dafe8275e59fee149'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.323927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf27fa464954c0dafe8275e59fee149'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.326847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf27fa464954c0dafe8275e59fee149'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.331618 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf27fa464954c0dafe8275e59fee149'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.332241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ab0dc371-2d5a-43f1-a7f0-beda81d32c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf27fa464954c0dafe8275e59fee149'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.349738 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:15.360345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db62b8-0336-47fe-a012-de2369bad831 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:15.365499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:15.368489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:15.368489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:15.368489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] PATH_INFO: `/v3/users/89c86385f234457ab8be15803fea65c9` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:15.368489 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c86385f234457ab8be15803fea65c9)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:15.370265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:15.403565 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:15.407826 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1281/2580] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:14 2022] DELETE /identity/v3/users/adf27fa464954c0dafe8275e59fee149 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:15.412798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:15.413092 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:15.413374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:15.430529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:15.431737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:15.470593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:15.490414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1282/2581] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:15.500040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:15.501390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:15.557823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c86385f234457ab8be15803fea65c9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.558726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14f2c-140f-4507-aeb0-a037c4516af8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:15.562489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:15.563142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:15.563545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:15.563827 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:15.570452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c86385f234457ab8be15803fea65c9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.571135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c86385f234457ab8be15803fea65c9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.573047 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:15.574655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a17a-c700-4f46-b8eb-98ba232c1427 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:15.580015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c86385f234457ab8be15803fea65c9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.585201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c86385f234457ab8be15803fea65c9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:15.585868 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1283/2582] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:15.670392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1300/2583] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:15 2022] DELETE /identity/v3/users/89c86385f234457ab8be15803fea65c9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:15.675169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:15.675461 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:15.675745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:15.695377 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:15.696603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:15.759415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1284/2584] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:15.769612 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:15.771257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:15.832976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc5e6b-36e2-43a1-b369-aa2a04231755 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:15.836509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:15.837480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:15.837480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:15.837704 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:15.847705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:15.849452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:15.859587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1301/2585] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:16.405518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:16.407055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:16.420500 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609b5a-9b80-480a-af8a-0a8b684476a6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:16.425923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:16.426807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.427350 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.427597 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] PATH_INFO: `/v3/projects/c63011eaeb4b4518abe31327ab86e44e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.428821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63011eaeb4b4518abe31327ab86e44e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:16.430994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:16.562252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:16.569096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63011eaeb4b4518abe31327ab86e44e', 'request_id': 'req-bd892496-610b-4eef-bdad-6f119f8c6eb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.575587 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63011eaeb4b4518abe31327ab86e44e', 'request_id': 'req-bd892496-610b-4eef-bdad-6f119f8c6eb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.581413 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63011eaeb4b4518abe31327ab86e44e', 'request_id': 'req-bd892496-610b-4eef-bdad-6f119f8c6eb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.678437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:16.679583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] The token cache is being invalidate because project c63011eaeb4b4518abe31327ab86e44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:16.681639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.681761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:16.681878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-bd892496-610b-4eef-bdad-6f119f8c6eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.685605 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1285/2586] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:16 2022] DELETE /identity/v3/projects/c63011eaeb4b4518abe31327ab86e44e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:16.687326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d674-6b6d-4b21-807c-689f773e81f3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.687737 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d674-6b6d-4b21-807c-689f773e81f3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.688695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d674-6b6d-4b21-807c-689f773e81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.693888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebd25-a6e4-478d-9b95-d523db817e36 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:16.712778 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e367d674-6b6d-4b21-807c-689f773e81f3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:16.714158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e367d674-6b6d-4b21-807c-689f773e81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:16.752942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:16.754257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.754917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.755253 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] PATH_INFO: `/v3/projects/29a683469cf44314ad425955b2e125b8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.756809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a683469cf44314ad425955b2e125b8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:16.759028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:16.777353 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1286/2587] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:16.787420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.787706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.787989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.807762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:16.808975 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:16.817304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1287/2588] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:16.821449 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:16.830964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da511f43-8683-4142-bbfa-7fee5351eb17 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:16.835803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:16.836326 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.836616 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.836895 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.837631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:16.837968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:16.839555 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:16.855198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1288/2589] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:14:16.860870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:16.870513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ca594-6eaf-43cb-8f39-636fea96b6d8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:16.876748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a683469cf44314ad425955b2e125b8', 'request_id': 'req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.878797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:16.927631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:16.928409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:16.928673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:16.928968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:16.929917 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:16.931891 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:16.965754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a683469cf44314ad425955b2e125b8', 'request_id': 'req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.972722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a683469cf44314ad425955b2e125b8', 'request_id': 'req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.984282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] The token cache is being invalidate because project 29a683469cf44314ad425955b2e125b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:16.984570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.985238 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:16.986806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1302/2590] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:16 2022] DELETE /identity/v3/projects/29a683469cf44314ad425955b2e125b8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:16.994861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:16.996148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.008551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ad42-2d2f-4ccc-98a0-8bb49abb1720 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.013564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.014549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.019897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.019897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] PATH_INFO: `/v3/users/4230401e398849f5868c8c65d86a5f25` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.019897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4230401e398849f5868c8c65d86a5f25)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.019897 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.038923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1289/2591] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:16 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:17.043058 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.044678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.078529 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:17.110011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbcf6b-427f-4c8f-ac5d-6ce1f80794f3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.114668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.115344 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.115629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.115908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.116600 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.118567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.212325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1290/2592] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:17 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:17.216230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.226886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3edec8-6b70-4d0f-8d37-fcc74f9eca03 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.231559 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.232212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.232613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.232892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.233655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.235288 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.246013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1291/2593] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:17.249524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4230401e398849f5868c8c65d86a5f25'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.249845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.259805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb2270-1857-4f61-b22e-3d49e84b2ff6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.262191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4230401e398849f5868c8c65d86a5f25'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.262942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4230401e398849f5868c8c65d86a5f25'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.264708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.265478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.265865 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.266270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.267080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.269357 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.270706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4230401e398849f5868c8c65d86a5f25'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.277464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6511b80d-1c98-4eaf-aafa-52ccca51cefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4230401e398849f5868c8c65d86a5f25'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.280078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1292/2594] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:17.284212 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.285998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.298576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198f93b-91ea-41b3-b629-8021156316ab admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.303549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.304422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.304711 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.305012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] PATH_INFO: `/v3/projects/b13c56f7a3a84af8b228fe0776c9a0cb/users/e278adbcf74845cfb667e6fdb04c1ba0/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.320440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13c56f7a3a84af8b228fe0776c9a0cb, user_id=e278adbcf74845cfb667e6fdb04c1ba0, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.323256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.355917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1303/2595] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:16 2022] DELETE /identity/v3/users/4230401e398849f5868c8c65d86a5f25 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:17.390780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1293/2596] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:17 2022] PUT /identity/v3/projects/b13c56f7a3a84af8b228fe0776c9a0cb/users/e278adbcf74845cfb667e6fdb04c1ba0/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:17.459210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.459503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.459784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.485985 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] MFA Rules not processed for user `e278adbcf74845cfb667e6fdb04c1ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:17.487128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.553202 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1304/2597] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:17.565439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.567781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.633613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b755a4-c0a0-49b3-b463-3f28fce05a4a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.637885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.638758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.639256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.639567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.648638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.650548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.660267 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1294/2598] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:17.688060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.731696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:17.751782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872ffd-2b49-4153-97bf-74d728bc7fff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.757116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.758070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.758397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.758684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] PATH_INFO: `/v3/users/e278adbcf74845cfb667e6fdb04c1ba0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.759900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e278adbcf74845cfb667e6fdb04c1ba0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.761815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.773089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:17.775360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:17.808145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872692b-9eb5-4a7e-a109-19e81cb10d13 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:17.813012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:17.813886 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:17.814196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:17.814478 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] PATH_INFO: `/v3/projects/00dd09113f154134bd0a5ad000297553` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:17.815681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00dd09113f154134bd0a5ad000297553)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:17.818301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:17.952939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00dd09113f154134bd0a5ad000297553', 'request_id': 'req-b3f79299-a02b-480d-b7a4-d16ea4873d8b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.953526 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e278adbcf74845cfb667e6fdb04c1ba0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.960187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00dd09113f154134bd0a5ad000297553', 'request_id': 'req-b3f79299-a02b-480d-b7a4-d16ea4873d8b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.966309 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e278adbcf74845cfb667e6fdb04c1ba0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.966622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00dd09113f154134bd0a5ad000297553', 'request_id': 'req-b3f79299-a02b-480d-b7a4-d16ea4873d8b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.967036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e278adbcf74845cfb667e6fdb04c1ba0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.974663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e278adbcf74845cfb667e6fdb04c1ba0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:17.975352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02fd077c-3cca-4980-abcd-6cbd189bae12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e278adbcf74845cfb667e6fdb04c1ba0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.057279 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] The token cache is being invalidate because project 00dd09113f154134bd0a5ad000297553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:18.057584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.058260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b3f79299-a02b-480d-b7a4-d16ea4873d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.059940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1295/2599] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:17 2022] DELETE /identity/v3/projects/00dd09113f154134bd0a5ad000297553 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:18.064694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f6c5-7b27-4cb5-b854-ccb3eac85169 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.065068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f6c5-7b27-4cb5-b854-ccb3eac85169 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.065516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f6c5-7b27-4cb5-b854-ccb3eac85169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.072820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:18.086623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fd54f6c5-7b27-4cb5-b854-ccb3eac85169 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:18.087848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fd54f6c5-7b27-4cb5-b854-ccb3eac85169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.115397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1305/2600] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:17 2022] DELETE /identity/v3/users/e278adbcf74845cfb667e6fdb04c1ba0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:18.120041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.120622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.121092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.148040 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:18.149467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.151507 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1296/2601] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:18.159010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.159306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.159590 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.177603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:18.178908 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.217370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1306/2602] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:18.227504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.229055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.239545 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1297/2603] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:18.244030 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.255197 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8db1c1-ee3a-4e53-a8d0-de567b9f12e1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.260610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.261734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.261734 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.262094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.262834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:18.263144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.264751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.279010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1298/2604] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:18.283591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.290257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4896d-0ac9-4477-a626-b2b3723559fe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.294055 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9f1a-86d6-4164-9436-75a480211b71 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.294170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.294662 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.294951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.295226 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.298509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.299199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.299480 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.299762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.300453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.302508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.304341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.305779 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.316121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1307/2605] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:18.419140 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1299/2606] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:18.423146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.428644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:18.433902 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4f038-1763-404c-955b-8ea625846693 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.491205 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.491873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.492158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.492442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.493141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.495108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.589366 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1308/2607] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:18.593786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.604796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d355-bd46-4c83-9803-1e719977e348 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.609427 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.610691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.610834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.611069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.611805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.613927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.624936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1300/2608] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:18.629641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.639725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfc9e-0e64-47f0-b124-ed52737ef8eb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.644706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.645152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.645436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.645713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.646613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.648224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.658512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1309/2609] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:18.664290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.674419 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3a76-9533-4a98-9937-d72a8845950d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.679673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.680604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.680890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.681166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] PATH_INFO: `/v3/projects/e27198c3f93341f6b7873a300a5882cd/users/f1d258d4b23240ffb2c3d26571d88066/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.696615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27198c3f93341f6b7873a300a5882cd, user_id=f1d258d4b23240ffb2c3d26571d88066, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.699201 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638209-3fee-4daf-8f6f-12e383934780 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.740753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.742600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.755950 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e968d89-86e8-469a-94ea-20244e05979f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.761360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:18.762880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.762880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.762880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] PATH_INFO: `/v3/projects/b13c56f7a3a84af8b228fe0776c9a0cb` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.764906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13c56f7a3a84af8b228fe0776c9a0cb)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:18.768996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:18.790057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1301/2610] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:18 2022] PUT /identity/v3/projects/e27198c3f93341f6b7873a300a5882cd/users/f1d258d4b23240ffb2c3d26571d88066/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:18.797209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.798232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.798232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.825077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] MFA Rules not processed for user `f1d258d4b23240ffb2c3d26571d88066`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:18.826313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:18.846131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:18.890477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1302/2611] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:18.892686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13c56f7a3a84af8b228fe0776c9a0cb', 'request_id': 'req-02f854d7-facf-47e7-bd32-2dcdc43e0c86'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.894561 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:18.950080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13c56f7a3a84af8b228fe0776c9a0cb', 'request_id': 'req-02f854d7-facf-47e7-bd32-2dcdc43e0c86'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.954297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174888f-b8df-40f7-89c7-b4bfcbee1202 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:18.957372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13c56f7a3a84af8b228fe0776c9a0cb', 'request_id': 'req-02f854d7-facf-47e7-bd32-2dcdc43e0c86'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.968227 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] The token cache is being invalidate because project b13c56f7a3a84af8b228fe0776c9a0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:18.968543 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.969250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-02f854d7-facf-47e7-bd32-2dcdc43e0c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:18.970824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1310/2612] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:18 2022] DELETE /identity/v3/projects/b13c56f7a3a84af8b228fe0776c9a0cb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:18.976207 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e59d9-6939-4e08-bf50-bac7a2143f65 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:18.976499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e59d9-6939-4e08-bf50-bac7a2143f65 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:18.976778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e59d9-6939-4e08-bf50-bac7a2143f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:18.994858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6c9e59d9-6939-4e08-bf50-bac7a2143f65 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:18.996237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6c9e59d9-6939-4e08-bf50-bac7a2143f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.011341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.012021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.012430 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.012706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.013410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.015313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.056239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1311/2613] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:19.063784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.064068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.064344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.082569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:19.088488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1303/2614] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:19.088628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.089927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.091575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.146833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1312/2615] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:19.147968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.154560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c80ac-cd0a-4d66-9f30-e58ab4a9c305 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.156671 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab948c-912e-4ec3-a1a6-20bdffc1a116 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.159334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.160784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.161309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.161440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.162129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.162430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.163146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.163505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.163848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.164088 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.164714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:19.165090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.166887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.177963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:19.183460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1313/2616] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:19.185587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.195427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ed61f-ac09-47f5-85c8-2c3a1977a3f9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.200009 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.200685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.200931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.201284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.201929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.203806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.226877 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:19.233929 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1304/2617] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:19.236901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.246879 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dccef-1656-427c-b0b6-d1174568b71d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.251655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.252454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.252836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.253209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.254087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.255761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.270234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1305/2618] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:19.271817 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.273248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1314/2619] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/projects => generated 399 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:19.278539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.285000 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22b1f-f9ed-4a95-998d-9b59b7440ce9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.351647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.357044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d610e8-f766-4ab2-aa2e-3b969abb1807 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.357188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.357188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.357188 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] PATH_INFO: `/v3/projects/5db774dfec8441d0a72cb704bc415784/users/d1707e0778754d83aaba63a94955df9d/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.357458 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.357763 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.358258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.358454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.359043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.360957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.458514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1315/2620] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:19.462963 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.474085 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1300-050e-416b-a8c9-afe2a6624d10 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.478837 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.479521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.479809 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.480082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.480820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.482471 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.493068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1316/2621] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:19.497243 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.507574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e777-62d2-4fee-a409-e3b5161585c2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.508652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db774dfec8441d0a72cb704bc415784, user_id=d1707e0778754d83aaba63a94955df9d, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.511477 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.512525 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.513186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.513467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.513741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.514504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.516304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.527886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1317/2622] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:19.531511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.542330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c1ed-c82b-4770-9dc8-becca546557f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.547028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.547908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.548188 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.548473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] PATH_INFO: `/v3/projects/fadca3e9e46f4523b6a1ea20e6bb195d/users/5a5b072d9fd04bc0b284de27ee72819f/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.563053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadca3e9e46f4523b6a1ea20e6bb195d, user_id=5a5b072d9fd04bc0b284de27ee72819f, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.565783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fc2ea-c3d5-4c2d-8bf6-09cf452271d5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.603657 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1306/2623] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:19 2022] PUT /identity/v3/projects/5db774dfec8441d0a72cb704bc415784/users/d1707e0778754d83aaba63a94955df9d/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:19.607596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.674372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df8ae-e283-45e4-8d2c-fd273bae5dfd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.679080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.679744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.680041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.680465 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.681141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.682892 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.688162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1318/2624] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:19 2022] PUT /identity/v3/projects/fadca3e9e46f4523b6a1ea20e6bb195d/users/5a5b072d9fd04bc0b284de27ee72819f/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:19.695845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1307/2625] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:19.699324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.699618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.699846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.699968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.711014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fd77f-3272-443a-8fef-f6a0ae682c05 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.727986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:19.731554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] MFA Rules not processed for user `5a5b072d9fd04bc0b284de27ee72819f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:19.732770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.762482 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:19.772173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.773066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.773348 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.773709 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] PATH_INFO: `/v3/projects/5db774dfec8441d0a72cb704bc415784/users/d1707e0778754d83aaba63a94955df9d/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.775634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db774dfec8441d0a72cb704bc415784, user_id=d1707e0778754d83aaba63a94955df9d, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:19.778290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e58896-a68c-4a07-b59a-0d55c8f8c587 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:19.793067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1308/2626] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:19 2022] PUT /identity/v3/projects/5db774dfec8441d0a72cb704bc415784/users/d1707e0778754d83aaba63a94955df9d/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:19.800299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.800694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.801043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.817234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1319/2627] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:19.829257 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.830972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.835519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] MFA Rules not processed for user `d1707e0778754d83aaba63a94955df9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:19.836697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.907785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eed78-e1e1-461f-a762-ef5168d80c85 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.909716 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1309/2628] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:19.921523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:19.922910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:19.971071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.971855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.972135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.972416 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:19.982782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469e0ce-e5bf-4702-9b23-2668702bd819 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:19.991624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:19.992396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:19.992756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:19.993101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:20.002676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:20.005022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:20.019331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1310/2629] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:20.032808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:20.034323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:20.043567 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1320/2630] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:20.237992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:20.247909 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc697d-66d7-41e0-ba6c-faa8afff38d5 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:20.251858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:20.252498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:20.252771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:20.253041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:20.255316 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:20.319200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:20.320524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:20.329544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1311/2631] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:23.710190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:23.711804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:23.726259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:23.783613 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c6475-0e72-43d9-a37e-3c87b21f1ad8 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:23.790605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:23.791284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:23.791571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:23.791848 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:23.793709 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:23.807016 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:23.809111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf7cb-ccf0-46dd-91ff-e21e2839ac14 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:23.821338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1321/2632] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:24.199791 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:24.214050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:24.262786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c371e1-b182-475b-953d-a57aa9950f21 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:24.267252 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:24.268127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:24.268435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:24.268712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] PATH_INFO: `/v3/users/f1d258d4b23240ffb2c3d26571d88066` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:24.270542 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d258d4b23240ffb2c3d26571d88066)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:24.274676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:24.471724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d258d4b23240ffb2c3d26571d88066'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:24.483881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d258d4b23240ffb2c3d26571d88066'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:24.484538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d258d4b23240ffb2c3d26571d88066'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:24.491499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d258d4b23240ffb2c3d26571d88066'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:24.492162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d258d4b23240ffb2c3d26571d88066'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:24.584983 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1312/2633] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:24 2022] DELETE /identity/v3/users/f1d258d4b23240ffb2c3d26571d88066 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:24.589464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:24.589758 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:24.590069 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:24.607220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:24.608419 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:24.668455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1322/2634] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:24.678193 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:24.679583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:24.735821 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d64dd3-9845-4c98-873d-a79a9db8384e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:24.739360 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:24.740002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:24.740285 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:24.740560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:24.749608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:24.751064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:24.760881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1313/2635] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:25.167802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:25.169333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:25.182549 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c6323-5452-418f-be29-3837e2bcfc08 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:25.196437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:25.197367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:25.197651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:25.197974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] PATH_INFO: `/v3/projects/e27198c3f93341f6b7873a300a5882cd` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:25.199302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27198c3f93341f6b7873a300a5882cd)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:25.201215 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:25.340062 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27198c3f93341f6b7873a300a5882cd', 'request_id': 'req-24470099-6e74-426a-9aa5-fc9f0219ffc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.464498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27198c3f93341f6b7873a300a5882cd', 'request_id': 'req-24470099-6e74-426a-9aa5-fc9f0219ffc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.470766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27198c3f93341f6b7873a300a5882cd', 'request_id': 'req-24470099-6e74-426a-9aa5-fc9f0219ffc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.482448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] The token cache is being invalidate because project e27198c3f93341f6b7873a300a5882cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:25.486240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.486240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.486240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1323/2636] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:25 2022] DELETE /identity/v3/projects/e27198c3f93341f6b7873a300a5882cd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:25.489635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:25.499361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a83c-b432-44a0-94b3-1e1b21a38f4e service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:25.531824 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:25.556541 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:25.557421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:25.557735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:25.558045 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] PATH_INFO: `/v3/users/d1707e0778754d83aaba63a94955df9d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:25.559244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1707e0778754d83aaba63a94955df9d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:25.561177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:25.758115 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1707e0778754d83aaba63a94955df9d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.769581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1707e0778754d83aaba63a94955df9d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.770269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1707e0778754d83aaba63a94955df9d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.777061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1707e0778754d83aaba63a94955df9d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.777738 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3d9f41c5-ab1c-461b-8d46-6d78b291d799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1707e0778754d83aaba63a94955df9d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:25.858990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1314/2637] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:25 2022] DELETE /identity/v3/users/d1707e0778754d83aaba63a94955df9d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:26.364256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:26.366187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:26.380841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470099-6e74-426a-9aa5-fc9f0219ffc8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:26.401728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:26.440725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:26.442145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.442426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.442700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] PATH_INFO: `/v3/projects/5db774dfec8441d0a72cb704bc415784` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.443880 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db774dfec8441d0a72cb704bc415784)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:26.445839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:26.544265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db774dfec8441d0a72cb704bc415784', 'request_id': 'req-d67314eb-d86e-45d1-a8a8-4db00c0d254c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:26.613006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db774dfec8441d0a72cb704bc415784', 'request_id': 'req-d67314eb-d86e-45d1-a8a8-4db00c0d254c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:26.619330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db774dfec8441d0a72cb704bc415784', 'request_id': 'req-d67314eb-d86e-45d1-a8a8-4db00c0d254c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:26.630228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] The token cache is being invalidate because project 5db774dfec8441d0a72cb704bc415784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:26.630516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:26.631152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d67314eb-d86e-45d1-a8a8-4db00c0d254c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:26.632736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1324/2638] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:26 2022] DELETE /identity/v3/projects/5db774dfec8441d0a72cb704bc415784 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:26.637754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.638265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.638385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.656581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:26.657775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:26.717514 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1315/2639] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:26.725853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.726172 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.726496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.744282 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:26.745490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:26.753583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1325/2640] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:26.757638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:26.767129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219592a2-d84f-41b8-a66b-071c26a41619 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:26.772195 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:26.772847 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.773127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.773395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.774169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:26.774472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:26.776067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:26.788247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1316/2641] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:26.792521 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:26.801841 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dd051-d96b-429a-9717-d522ae1e3b7b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:26.806474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:26.807130 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.807440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.807719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.808421 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:26.810344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:26.894948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1326/2642] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:26 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:26.899023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:26.908854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3dcb-305f-4479-875f-7bfcbffff158 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:26.948257 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:26.965067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:26.965733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:26.966076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:26.966340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:26.967029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:26.968948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.063008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1317/2643] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:26 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:27.067570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.077829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d57f2-0c96-4f86-b878-028167e715c5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.083376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.084693 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.085170 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.085456 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.086248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.087857 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.098928 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1327/2644] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:27.103431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.113570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dae33-419b-4b9f-9ca1-87a234e8154c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.118373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.119033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.119311 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.119584 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.120406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.122004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e51a-83ec-4a96-8a5b-a449f56fa8fd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.132687 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1318/2645] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:27.136829 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.147426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d0ef-909c-4dac-bc50-439f94cfd713 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.151949 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.152827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.153103 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.153432 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] PATH_INFO: `/v3/projects/186ca2b14e714dfaacd5c45fe447b718/users/742b464d8d464bcab1d5386b51283472/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.167706 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186ca2b14e714dfaacd5c45fe447b718, user_id=742b464d8d464bcab1d5386b51283472, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.170376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.268447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1328/2646] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:27 2022] PUT /identity/v3/projects/186ca2b14e714dfaacd5c45fe447b718/users/742b464d8d464bcab1d5386b51283472/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:27.280950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.281238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.281522 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.307818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] MFA Rules not processed for user `742b464d8d464bcab1d5386b51283472`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:27.309029 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:27.375136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1319/2647] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:27.380155 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.432056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:27.446129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed782-984a-4f28-ad67-be76ba69bb48 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.451528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.452197 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.452480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.452893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.453608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.455823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.575376 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1329/2648] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:27 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:27.579505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.591861 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c080-2ead-43c6-aca7-ec35f9e3f516 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.660033 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.660672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.660952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.661234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.661984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.664059 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.750701 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1320/2649] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:27 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:27.754745 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.765111 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a8eb0-3f02-4a68-a0b1-3669a5ba3204 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.769645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.770337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.770630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.770908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.771640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.773246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.784650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1330/2650] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:27.789374 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.799550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27d6d-1d03-47d1-80e9-1eed5409b8da admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.804663 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.805535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.805812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.806111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] PATH_INFO: `/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f/users/898f22e36b304cdd8e5637e6bf5621b1/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.821042 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276c0e38d3ef4d0b9594b0794b71ee6f, user_id=898f22e36b304cdd8e5637e6bf5621b1, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.823728 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.887132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1321/2651] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:27 2022] PUT /identity/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f/users/898f22e36b304cdd8e5637e6bf5621b1/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:27.891041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.900789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e5b8-9ce8-4fa1-926f-af6ec0244f32 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.961728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.962430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.962710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.962984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.963718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:27.965299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98a60c-2f17-455c-b640-2b4df5471405 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:27.975825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1331/2652] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:27.980048 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:27.990968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dce82-904b-46ae-9069-8260398a0158 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:27.995606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:27.996487 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:27.996770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:27.997050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] PATH_INFO: `/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f/users/898f22e36b304cdd8e5637e6bf5621b1/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:27.999106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276c0e38d3ef4d0b9594b0794b71ee6f, user_id=898f22e36b304cdd8e5637e6bf5621b1, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:28.001733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:28.012783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1322/2653] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:27 2022] PUT /identity/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f/users/898f22e36b304cdd8e5637e6bf5621b1/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:28.023200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:28.023493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:28.023780 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:28.050203 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] MFA Rules not processed for user `898f22e36b304cdd8e5637e6bf5621b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:28.052057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:28.119179 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1332/2654] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:28.130767 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:28.132481 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:28.137842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:28.189547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3759a-f961-4469-96d7-f6a72a0d2632 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:28.193333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:28.194081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:28.194290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:28.194564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:28.204210 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:28.206038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48759f79-8f46-4b92-8b6d-b0a82b5a0569 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:28.216703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1323/2655] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:28.282196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:28.327494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:28.344358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a52a-8fbe-40b4-b6da-7c3529fc0caa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:28.349528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:28.350452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:28.350733 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:28.351004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] PATH_INFO: `/v3/users/742b464d8d464bcab1d5386b51283472` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:28.352200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=742b464d8d464bcab1d5386b51283472)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:28.354145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:28.577279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742b464d8d464bcab1d5386b51283472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:28.593002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742b464d8d464bcab1d5386b51283472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:28.593755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742b464d8d464bcab1d5386b51283472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:28.600978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742b464d8d464bcab1d5386b51283472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:28.601675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742b464d8d464bcab1d5386b51283472'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:28.681981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1333/2656] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:28 2022] DELETE /identity/v3/users/742b464d8d464bcab1d5386b51283472 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:28.686774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:28.687287 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:28.687387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:28.705741 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:28.706995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:28.767941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1324/2657] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:28.778660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:28.780139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:28.844609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf5f8-0a6c-4c1f-a0f4-1de110d09d8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:28.848666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:28.849509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:28.849964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:28.850297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:28.860469 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:28.861995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:28.872072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1334/2658] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:29.287792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:29.290365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:29.309355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887d00-9152-46a6-badb-23b6f49af701 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:29.310967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:29.312027 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:29.312358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:29.312627 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] PATH_INFO: `/v3/projects/186ca2b14e714dfaacd5c45fe447b718` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:29.313772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186ca2b14e714dfaacd5c45fe447b718)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:29.315758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:29.442913 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186ca2b14e714dfaacd5c45fe447b718', 'request_id': 'req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.449515 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186ca2b14e714dfaacd5c45fe447b718', 'request_id': 'req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.458280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186ca2b14e714dfaacd5c45fe447b718', 'request_id': 'req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.547779 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] The token cache is being invalidate because project 186ca2b14e714dfaacd5c45fe447b718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:29.548066 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.548708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.550310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1325/2659] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:29 2022] DELETE /identity/v3/projects/186ca2b14e714dfaacd5c45fe447b718 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:29.554279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:29.564336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a555c3d-7e2f-490d-82ed-65f77e703f1c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:29.623027 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:29.624021 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:29.624311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:29.624591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] PATH_INFO: `/v3/users/898f22e36b304cdd8e5637e6bf5621b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:29.625962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=898f22e36b304cdd8e5637e6bf5621b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:29.627937 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:29.634350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:29.804176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898f22e36b304cdd8e5637e6bf5621b1'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.817401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898f22e36b304cdd8e5637e6bf5621b1'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.818045 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898f22e36b304cdd8e5637e6bf5621b1'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.825533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898f22e36b304cdd8e5637e6bf5621b1'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.827147 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-77750281-ee8a-4ae2-8fed-ede7904c25dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898f22e36b304cdd8e5637e6bf5621b1'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:29.908318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1335/2660] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:29 2022] DELETE /identity/v3/users/898f22e36b304cdd8e5637e6bf5621b1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:30.413156 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:30.414806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:30.430591 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ba8d7-6f65-4e0b-b2be-82514ca74e28 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:30.459395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:30.490136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:30.491043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:30.491369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:30.491730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] PATH_INFO: `/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:30.492967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] RBAC: Authorizing `identity:delete_project(project_id=276c0e38d3ef4d0b9594b0794b71ee6f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:30.494922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:30.619691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276c0e38d3ef4d0b9594b0794b71ee6f', 'request_id': 'req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:30.626301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276c0e38d3ef4d0b9594b0794b71ee6f', 'request_id': 'req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:30.632450 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276c0e38d3ef4d0b9594b0794b71ee6f', 'request_id': 'req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:30.805871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] The token cache is being invalidate because project 276c0e38d3ef4d0b9594b0794b71ee6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:30.806175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:30.806799 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92cebc5d-ca0a-4381-bfc7-7a1b9294186b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:30.808491 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1326/2661] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:30 2022] DELETE /identity/v3/projects/276c0e38d3ef4d0b9594b0794b71ee6f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:30.813539 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:30.814028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:30.814189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:30.833004 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:30.834296 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:30.891553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1336/2662] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:30.899457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:30.899795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:30.900090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:30.918939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:30.920428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:30.929111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1327/2663] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:30.936802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:30.946606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cfe55-c817-4367-a69c-cfcb6d975590 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:30.951330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:30.952193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:30.952321 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:30.952552 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:30.953287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:30.953596 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:30.955601 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:30.967714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1337/2664] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:30.972060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:30.984368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3513-1c38-4031-9a98-33895f3695d0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:30.988389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:30.989620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:30.989922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:30.990200 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:30.990905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:30.992922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.113388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1328/2665] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:30 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:31.114939 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.125256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78227dcd-e476-4487-94bc-87f7486bac92 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.184647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.185329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.185607 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.185879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.186599 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.188524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.247371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.249219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.309769 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8937d-7252-4ce6-bf46-2b4c7f4783b2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.310370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1338/2666] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:31 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:31.311105 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.312797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.316524 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.317615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.317760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.318105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.320021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.320844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:31.326195 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dd2d6-b118-4983-8f1d-534fee589732 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.331302 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.332838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.333145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.334194 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] PATH_INFO: `/v3/users/5a5b072d9fd04bc0b284de27ee72819f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.335477 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5b072d9fd04bc0b284de27ee72819f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.348784 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.368369 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:31.386329 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.387812 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.398320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1329/2667] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:31.399163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.409051 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d997ed-a631-482f-a574-9dbaa173f428 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.414361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.415034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.415319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.415595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.416321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.418065 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.428873 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1330/2668] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:31.432770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.447667 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d7945-9db2-4c22-a5b0-9b0f8f619e0b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.452424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.453105 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.453393 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.453668 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.454439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.456292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.467143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1331/2669] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:14:31.471385 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.481693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856edd49-89aa-4bb7-988e-dbff70080e5e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.486426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.487322 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.487595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.487871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] PATH_INFO: `/v3/projects/9968e84a8d924767bd91e6bd2864d00b/users/34ab1be1654043cab782b9e0b1fd7470/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.489657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5b072d9fd04bc0b284de27ee72819f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:31.502388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5b072d9fd04bc0b284de27ee72819f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:31.505408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9968e84a8d924767bd91e6bd2864d00b, user_id=34ab1be1654043cab782b9e0b1fd7470, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.505532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5b072d9fd04bc0b284de27ee72819f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:31.505989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adbb7-2560-4938-920c-11812e6264a2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.510595 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5b072d9fd04bc0b284de27ee72819f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:31.511262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e7c03b7d-ef79-4c62-b73d-4cba7323c17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5b072d9fd04bc0b284de27ee72819f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:31.589862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1339/2670] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:31 2022] DELETE /identity/v3/users/5a5b072d9fd04bc0b284de27ee72819f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:31.590685 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1332/2671] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:31 2022] PUT /identity/v3/projects/9968e84a8d924767bd91e6bd2864d00b/users/34ab1be1654043cab782b9e0b1fd7470/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:31.602815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.603120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.603392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.604270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.604575 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.604859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.621426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:31.622797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.633560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] MFA Rules not processed for user `34ab1be1654043cab782b9e0b1fd7470`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:31.635324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.700622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1340/2672] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:31.711371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.715783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1333/2673] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:31.715956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.746447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.747969 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.789556 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4530c-5b8b-4520-8101-2cad373fe822 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.801994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.801994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.801994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.801994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.806715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.808167 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.819028 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1341/2674] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:31.830289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3ae5-3cc1-4194-8f07-417502f6b1dc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.835671 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.836351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.836637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.836915 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.848024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.849415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.859613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1334/2675] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:31.874364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:31.876060 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:31.890988 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25edfd-b690-43a0-85f2-8923f2d18e02 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:31.896433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:31.897856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:31.898397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:31.898846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] PATH_INFO: `/v3/users/34ab1be1654043cab782b9e0b1fd7470` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:31.900137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ab1be1654043cab782b9e0b1fd7470)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:31.902217 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:31.920513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:32.169516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ab1be1654043cab782b9e0b1fd7470'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.187275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ab1be1654043cab782b9e0b1fd7470'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.192426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ab1be1654043cab782b9e0b1fd7470'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.197770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ab1be1654043cab782b9e0b1fd7470'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.198495 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-66e89c38-9c38-4050-a130-0ff4badedc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ab1be1654043cab782b9e0b1fd7470'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.264706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:32.266893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:32.280295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1342/2676] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:14:31 2022] DELETE /identity/v3/users/34ab1be1654043cab782b9e0b1fd7470 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:32.291578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374651ac-9d9d-4db9-b9a3-defdb9a13552 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:32.298533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.298533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.298533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.313594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:32.315017 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:32.328098 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:32.369001 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:32.370016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.370299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.370574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] PATH_INFO: `/v3/projects/fadca3e9e46f4523b6a1ea20e6bb195d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.372004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadca3e9e46f4523b6a1ea20e6bb195d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:32.374216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:32.389174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1343/2677] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:32.399538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:32.401436 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:32.461867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64ba17-3631-483d-88ce-c5d9814e3033 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:32.467470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:32.468177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.468470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.468754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.479136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:32.481472 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18908f83-96b2-4efa-b139-f7c7e08c7b2e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:32.492200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1344/2678] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:32.501143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadca3e9e46f4523b6a1ea20e6bb195d', 'request_id': 'req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.507904 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadca3e9e46f4523b6a1ea20e6bb195d', 'request_id': 'req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.513572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadca3e9e46f4523b6a1ea20e6bb195d', 'request_id': 'req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.627977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] The token cache is being invalidate because project fadca3e9e46f4523b6a1ea20e6bb195d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:32.628400 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.629046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ad1ee731-fd94-4131-86cf-1cddc5d48aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:32.630637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1335/2679] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:32 2022] DELETE /identity/v3/projects/fadca3e9e46f4523b6a1ea20e6bb195d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:32.636337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.636636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.636913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.656519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:32.657754 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:32.691707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:32.736791 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1345/2680] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:32.738576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.738998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.739281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.761977 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:32.763286 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:32.772131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1336/2681] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:32.776363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:32.788132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582f3f-a49f-49c0-a943-f48a7280c8e5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:32.794385 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:32.795064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.795347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.795622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.796575 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:32.796804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:32.798497 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:32.814568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1346/2682] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:32.815996 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:32.826952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547fd5d-707a-43f3-9874-99d9f4e151b5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:32.833022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:32.833501 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:32.833788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:32.834659 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:32.835403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:32.837368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:32.951763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1337/2683] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:32 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:32.952640 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:32.965760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8b9d-24d9-45fe-b60e-80f855fef122 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.031260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.031958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.032244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.032531 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.033250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.035786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.129925 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1347/2684] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:32 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:14:33.132550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.142869 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09639a7-eae0-40ec-b061-108edc611301 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.148175 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.148893 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.149178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.149453 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.150230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.151811 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.162681 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1338/2685] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:33.166719 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.176932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d846d68-abe0-4691-84e1-aa4ca6097804 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.181538 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.182230 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.182511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.182783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.183513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.185098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.195776 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1348/2686] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:33.200049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.214918 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035925a0-d4a1-43e0-ab6f-f24afca16e51 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.216753 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.217712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.218091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.218391 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] PATH_INFO: `/v3/projects/d9c46b1e7a32484b9c22387f2aaeb871/users/782845f8e6a440b684ae46a6ed118a62/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.235397 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c46b1e7a32484b9c22387f2aaeb871, user_id=782845f8e6a440b684ae46a6ed118a62, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.238076 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecff10f-b06a-4f1f-8cd4-1dcf76f91690 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.258068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.258068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:33.258068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ece51-e1e1-4686-bf4b-7b0df729e68f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.265163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.266204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.266582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.267292 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] PATH_INFO: `/v3/projects/9968e84a8d924767bd91e6bd2864d00b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.268151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9968e84a8d924767bd91e6bd2864d00b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.271037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.369361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1339/2687] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:33 2022] PUT /identity/v3/projects/d9c46b1e7a32484b9c22387f2aaeb871/users/782845f8e6a440b684ae46a6ed118a62/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:33.374476 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.374763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.375034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.387157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9968e84a8d924767bd91e6bd2864d00b', 'request_id': 'req-ca2e138f-204c-4b1f-ab43-1532870790c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:33.394729 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:33.396043 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:33.430082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9968e84a8d924767bd91e6bd2864d00b', 'request_id': 'req-ca2e138f-204c-4b1f-ab43-1532870790c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:33.439273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9968e84a8d924767bd91e6bd2864d00b', 'request_id': 'req-ca2e138f-204c-4b1f-ab43-1532870790c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:33.455964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] The token cache is being invalidate because project 9968e84a8d924767bd91e6bd2864d00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:14:33.456256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:33.457090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca2e138f-204c-4b1f-ab43-1532870790c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:14:33.458782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1349/2688] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:14:33 2022] DELETE /identity/v3/projects/9968e84a8d924767bd91e6bd2864d00b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:14:33.470577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:33.470919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee86-27ab-4e67-94d7-f05ff10a5f18 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.470919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee86-27ab-4e67-94d7-f05ff10a5f18 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.470919 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee86-27ab-4e67-94d7-f05ff10a5f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.480572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1340/2689] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:33.486692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fce7ee86-27ab-4e67-94d7-f05ff10a5f18 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:33.487909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fce7ee86-27ab-4e67-94d7-f05ff10a5f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:33.491271 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.494613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:33.502289 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1350/2690] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:33.508562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.509114 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.509557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.535151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:33.537484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:33.552502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1351/2691] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:33.554372 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.565357 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a68dd-b1f2-4801-9d6f-b28b0aeb8982 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.571437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d56813-b7e6-4359-8843-b3dbdf32dfd6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.572783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.573571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.574065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.578868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.578868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:14:33.578868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.578868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.580163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.580163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.580163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.580163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.580871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:33.590939 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.595535 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1352/2692] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:14:33.595695 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.596728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.606106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1341/2693] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:14:33.614517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40247f-424a-4a32-a59c-1baddf3d2bbd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.619854 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.620789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.621871 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.622212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.623493 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.625375 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.720870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1353/2694] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:33 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:33.725457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.734979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8765e-6ac1-4b99-8e30-061ab2cda3a1 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.800732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.802204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.802485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.802754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.803455 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.805717 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.929499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1342/2695] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:33 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:33.933998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.944898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129894f-8ec8-4306-b437-3f7f7c9c9b0d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.951237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.951975 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.952262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.952542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.953287 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.955392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:33.966234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1354/2696] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:33.974343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:33.984611 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ad7d-178f-4f24-9dc1-36b2848b4e3f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:33.993349 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:33.996756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:33.996756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:33.996756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:33.996756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:33.997067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c3b72-43da-4a3a-9f38-0e30b06a7554 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:34.008528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1343/2697] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:34.012571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:34.023095 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae937-452f-4ba3-bdcb-7d30d1656d63 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:34.027796 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:34.028983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:34.029224 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:34.030222 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] PATH_INFO: `/v3/projects/ce0a605265304e269a251307d780f64b/users/f6029025ab914d5f927490f1c203f0a0/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:34.058369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0a605265304e269a251307d780f64b, user_id=f6029025ab914d5f927490f1c203f0a0, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:34.062676 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:34.163496 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1355/2698] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:34 2022] PUT /identity/v3/projects/ce0a605265304e269a251307d780f64b/users/f6029025ab914d5f927490f1c203f0a0/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:34.174131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc93e-a6d5-41b9-b667-ae413560fe4a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:34.174421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc93e-a6d5-41b9-b667-ae413560fe4a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:34.174702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc93e-a6d5-41b9-b667-ae413560fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:34.203987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-19afc93e-a6d5-41b9-b667-ae413560fe4a None None] MFA Rules not processed for user `f6029025ab914d5f927490f1c203f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:34.205678 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-19afc93e-a6d5-41b9-b667-ae413560fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:34.289574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1344/2699] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:34.302505 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:34.304263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:34.374090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bd2a9-7699-4043-9404-11782351ccff admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:34.378242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:34.379008 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:34.379418 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:34.379701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:34.389560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:34.391072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:34.402102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1356/2700] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:39.483328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:39.484141 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:39.484525 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:39.494081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:39.519498 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] MFA Rules not processed for user `782845f8e6a440b684ae46a6ed118a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:39.521086 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:39.594613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1345/2701] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:39.599352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:39.600972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:39.677002 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610599d2-006d-4cf7-854f-398b078d61d5 service glance] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:39.683190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:39.683889 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:39.684174 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:39.684455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:39.685175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:39.687163 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:39.780413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1357/2702] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:39.785795 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:39.799166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f383e9-a4db-4ef4-b1fd-f628a0c1e54c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:39.872435 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:39.873152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:39.873437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:39.873751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:39.874454 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:39.876371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:39.993404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1346/2703] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:14:39 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:14:39.994425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:40.012644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7be3f0-a11d-4d9a-a1a4-839e72693ee0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:40.017973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:40.018685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:40.018976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:40.019255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:40.020669 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:40.022319 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:40.037211 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1358/2704] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:40.038474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:40.048830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f5d-0c46-4477-b479-a2a88c83c88b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:40.054003 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:40.055035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:40.055426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:40.055763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] PATH_INFO: `/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629/users/9a4c3137728e4203b126f963218d9fbc/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:40.072815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfaa71f564d47c1b9fc6cca168c2629, user_id=9a4c3137728e4203b126f963218d9fbc, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:40.075607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:40.194120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1347/2705] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:40 2022] PUT /identity/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629/users/9a4c3137728e4203b126f963218d9fbc/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:40.197924 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:40.210293 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3efe9-bd4e-4f36-b8df-fd792bf3acc7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:40.226858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:40.275544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:40.276234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:40.277068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:40.277068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:40.277885 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:40.279270 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274b1e9-bbc7-40fe-a2e4-70268b508cb8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:40.290466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1359/2706] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:14:40.294669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:40.309012 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf5d7-cc40-43c1-8e43-ea7afe2d0895 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:40.313859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:40.314842 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:40.315127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:40.315408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] PATH_INFO: `/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629/users/9a4c3137728e4203b126f963218d9fbc/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:40.318169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfaa71f564d47c1b9fc6cca168c2629, user_id=9a4c3137728e4203b126f963218d9fbc, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:40.323499 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:40.332192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1348/2707] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:14:40 2022] PUT /identity/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629/users/9a4c3137728e4203b126f963218d9fbc/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:14:46.178129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2c42-a650-4c5d-b2b7-46c54372005c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:46.178812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2c42-a650-4c5d-b2b7-46c54372005c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:46.178812 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2c42-a650-4c5d-b2b7-46c54372005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:46.209686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2f9d2c42-a650-4c5d-b2b7-46c54372005c None None] MFA Rules not processed for user `9a4c3137728e4203b126f963218d9fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:46.210986 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2f9d2c42-a650-4c5d-b2b7-46c54372005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:46.299119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1360/2708] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:14:46.317378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:14:46.319444 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:46.386123 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:46.418686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abee5e7-13a1-4e3f-9ac1-0f4593e788c7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:14:46.432456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:14:46.433136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:46.433429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:46.433700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:46.502833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:14:46.502833 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:14:46.513420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1349/2709] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:14:49.351240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596862-312b-4fba-8621-55c64a3ef2ae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:14:49.351757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596862-312b-4fba-8621-55c64a3ef2ae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:14:49.351865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596862-312b-4fba-8621-55c64a3ef2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:14:49.369314 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-57596862-312b-4fba-8621-55c64a3ef2ae None None] MFA Rules not processed for user `782845f8e6a440b684ae46a6ed118a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:14:49.370502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-57596862-312b-4fba-8621-55c64a3ef2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:14:49.377294 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1361/2710] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:14:56.669725 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=35 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:14:59.364006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=59 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:13.369781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:13.430759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cca74-25a6-4230-9423-e4700dc33959 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:13.435289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:13.436150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:13.436434 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:13.436712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] PATH_INFO: `/v3/users/f6029025ab914d5f927490f1c203f0a0` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:13.437922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6029025ab914d5f927490f1c203f0a0)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:13.439855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:13.614665 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6029025ab914d5f927490f1c203f0a0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:13.626331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6029025ab914d5f927490f1c203f0a0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:13.627072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6029025ab914d5f927490f1c203f0a0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:13.633999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6029025ab914d5f927490f1c203f0a0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:13.634630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6029025ab914d5f927490f1c203f0a0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:13.702574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1350/2711] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:15:13 2022] DELETE /identity/v3/users/f6029025ab914d5f927490f1c203f0a0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:15:13.707428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:13.707914 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:13.710461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:13.725557 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:13.726786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:13.783952 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1362/2712] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:13.794395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:13.795806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:13.853119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544764a-667e-4bb9-bb26-4e1867b727b7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:13.856761 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:13.857407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:13.857690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:13.857995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:13.866831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:13.868240 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98753e-d8ce-4b07-94fe-5d4ebcc5a9e4 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:13.877388 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1351/2713] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:15:14.281364 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:14.282898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:14.296067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0565-4360-45b0-a1ce-bd550efd3e4c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:14.300929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:14.302352 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.302646 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.302981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] PATH_INFO: `/v3/projects/ce0a605265304e269a251307d780f64b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.304102 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0a605265304e269a251307d780f64b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:14.306023 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:14.429266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0a605265304e269a251307d780f64b', 'request_id': 'req-b7edc3aa-4450-4d25-86f8-dda73afe2b90'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:14.519736 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0a605265304e269a251307d780f64b', 'request_id': 'req-b7edc3aa-4450-4d25-86f8-dda73afe2b90'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:14.525696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0a605265304e269a251307d780f64b', 'request_id': 'req-b7edc3aa-4450-4d25-86f8-dda73afe2b90'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:14.537241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] The token cache is being invalidate because project ce0a605265304e269a251307d780f64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:15:14.537527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:14.538182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7edc3aa-4450-4d25-86f8-dda73afe2b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:15:14.539766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1363/2714] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:15:14 2022] DELETE /identity/v3/projects/ce0a605265304e269a251307d780f64b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:15:14.544740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.545199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.545320 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.563167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:14.564426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:14.581155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:14.622735 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1352/2715] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:14.630692 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.630981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.631259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.649650 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:14.655792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:14.658724 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1364/2716] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:14.663689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:14.673387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cb64e-d3dd-450d-b0f9-b9ca589277eb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:14.678784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:14.679558 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.679841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.680114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.680857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:15:14.681163 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:14.682786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:14.694903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1353/2717] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:15:14.699361 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:14.709422 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3c9f5-6a90-429c-9a2c-751e58c6201f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:14.714622 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:14.715276 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.715560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.715834 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.716519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:14.718453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:14.813121 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1365/2718] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:15:14 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:15:14.817398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:14.827333 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132d81-48ca-4220-828f-9a0770c3b8d8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:14.883075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:14.883732 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.884016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.884295 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.884990 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:14.886964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:14.972715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1354/2719] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:15:14 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:15:14.976931 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:14.987437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdde00-face-4999-bde8-0400aeb51a0d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:14.992279 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:14.994104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:14.994104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:14.994104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:14.994427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:14.995944 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:15.006920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1366/2720] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:15:15.010871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:15.021845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbeb50-85b1-42db-804d-3bfb7418f267 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:15.026901 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:15.027578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:15.027863 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:15.028145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:15.028882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:15.030581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586f546-8867-4801-b51f-2d9e3db34dd9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:15.040758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1355/2721] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:15:15.044951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:15.057285 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322b662-f70d-41d3-8e2f-2f46d348f53d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:15.059770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:15.060654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:15.060936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:15.061210 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] PATH_INFO: `/v3/projects/329e95cbfdb9493d82941bc00dd1ccbe/users/19f6c089e7ec4ca5914d760e742d89b3/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:15.076347 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=329e95cbfdb9493d82941bc00dd1ccbe, user_id=19f6c089e7ec4ca5914d760e742d89b3, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:15.079433 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:15.125872 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1367/2722] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:15:15 2022] PUT /identity/v3/projects/329e95cbfdb9493d82941bc00dd1ccbe/users/19f6c089e7ec4ca5914d760e742d89b3/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:15:15.131508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:15.131796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:15.132075 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:15.150190 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:15.151390 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:15.209635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1356/2723] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:15.219201 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:15.220886 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:15.241827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:15.278252 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983455-eabb-4c21-88aa-6b40b8b93b8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:15.282173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:15.282836 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:15.283122 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:15.283401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:15.292787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:15.294260 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa78ab-2499-490a-912d-a43a896ea350 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:15.304229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1368/2724] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:15:16.709994 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:16.732894 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973705-3b73-447f-92f4-d753967dfd6c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:16.733431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973705-3b73-447f-92f4-d753967dfd6c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:16.733526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1342c0e-536b-414f-b21a-62b63e5396cf None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:16.733635 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973705-3b73-447f-92f4-d753967dfd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:16.737448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:16.738152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:16.738437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:16.738887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:16.740731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:16.765358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:16.768460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:16.776306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e9973705-3b73-447f-92f4-d753967dfd6c None None] MFA Rules not processed for user `19f6c089e7ec4ca5914d760e742d89b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:16.777593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e9973705-3b73-447f-92f4-d753967dfd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:16.779050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1357/2725] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:15:16.867502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1369/2726] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:15:16.878325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:16.880641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:16.885560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:16.940581 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20cb-9cd9-49a9-9073-cc01aef5bfb1 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:16.944775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:16.945429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:16.945714 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:16.946016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:16.954629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:16.956040 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:16.964768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1358/2727] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:15:18.883360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a11-ea11-4b5b-81bd-4b0aa3fced31 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:18.883929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a11-ea11-4b5b-81bd-4b0aa3fced31 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:18.883929 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a11-ea11-4b5b-81bd-4b0aa3fced31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:18.901405 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-67975a11-ea11-4b5b-81bd-4b0aa3fced31 None None] MFA Rules not processed for user `19f6c089e7ec4ca5914d760e742d89b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:18.902659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-67975a11-ea11-4b5b-81bd-4b0aa3fced31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:18.909562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1370/2728] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:21.263401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:21.264936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:21.408516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554e864-13b1-4698-91d5-9243bbcdd0c0 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:21.426203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:21.427429 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:21.428145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:21.428712 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:21.432023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:21.450263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:21.462810 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:21.478094 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1359/2729] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:15:28.896600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=62 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:31.470831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=69 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:15:48.309536 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:48.310112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:48.310112 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:48.328440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] MFA Rules not processed for user `8efe37a6d57b4775b4e47a295c3f5eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:15:48.329734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:48.385748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1371/2730] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:15:50.102214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:15:50.123509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019c584-1480-4d35-b52f-13c0b1277b71 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:15:50.127372 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:15:50.128010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:15:50.128290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:15:50.128564 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:15:50.130359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:15:50.200293 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:15:50.201724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:15:50.212107 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1360/2731] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:15:58.379134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=25 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:00.207226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=34 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:06.710580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:16:06.723772 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45844ad0-e03f-48e6-b054-fc745f13b5f6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:16:06.732426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:16:06.732426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:16:06.732426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:16:06.732426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:16:06.733838 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:16:06.747161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:16:06.748741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd4988-4ba6-4321-934c-f741342c578f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:16:06.759480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1372/2732] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:16:16.754951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:16:52.562466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:16:52.563856 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:16:52.662789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98d4e4-ffee-494e-8954-fa6963d18aed service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:16:52.668633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:16:52.669277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:16:52.669562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:16:52.669883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:16:52.671669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:16:52.683836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:16:52.685404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:16:52.695463 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1361/2733] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:17:02.691100 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=41 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:08.658770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:08.659342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:08.659342 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:08.677532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] MFA Rules not processed for user `19f6c089e7ec4ca5914d760e742d89b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:17:08.680457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:08.685790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1373/2734] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:17:08.921548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:08.930882 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afcd7-a347-4495-b460-0d70de474844 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:08.934497 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:08.935130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:08.935410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:08.935682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:08.937464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:08.961474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:08.962926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:08.972700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1362/2735] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:17:18.672161 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:18.968603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=11 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:22.136524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:22.138047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:22.150149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628d7e-0857-4f5a-9586-8cde917352ad None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:22.153802 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:22.154507 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:22.154789 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:22.155065 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:22.156799 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:22.190044 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:22.191484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:22.210881 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1374/2736] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:17:25.651486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:25.653604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:25.670947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0769-d544-443a-8bc5-b38fe6a006bc service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:25.689702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:25.689702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:25.689702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:25.689702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:25.690216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:25.694781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:25.696650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:25.707601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1363/2737] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:17:29.259777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:29.272082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55717a3-2c12-4d86-a8ab-ffcccfa0089f service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:29.278067 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:29.278806 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:29.279158 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:29.279499 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:29.281341 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:29.293388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:29.295072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:29.305681 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1375/2738] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:17:29.400733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:29.402297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:29.416788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867ca4d-e358-488b-9e72-415e6687ff50 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:29.421217 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:29.422162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:29.422470 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:29.422750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] PATH_INFO: `/v3/users/546cd066c4244bffacbfea21f5e4f437` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:29.423944 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546cd066c4244bffacbfea21f5e4f437)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:29.425911 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:29.599282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546cd066c4244bffacbfea21f5e4f437'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:29.612599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546cd066c4244bffacbfea21f5e4f437'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:29.614927 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546cd066c4244bffacbfea21f5e4f437'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:29.620459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546cd066c4244bffacbfea21f5e4f437'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:29.621162 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546cd066c4244bffacbfea21f5e4f437'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:29.704933 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1364/2739] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:17:29 2022] DELETE /identity/v3/users/546cd066c4244bffacbfea21f5e4f437 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:17:29.991807 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:30.004589 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dff67-9a51-4bb7-b029-404dda15ac9c service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:30.066581 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:30.067484 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:30.067769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:30.068048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] PATH_INFO: `/v3/projects/8e511490c0f8438fb89ac590bd63529f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:30.069367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e511490c0f8438fb89ac590bd63529f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:30.071895 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:30.333275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e511490c0f8438fb89ac590bd63529f', 'request_id': 'req-2211a501-ab15-4443-ae2f-5c6e845aa8cd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.423755 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e511490c0f8438fb89ac590bd63529f', 'request_id': 'req-2211a501-ab15-4443-ae2f-5c6e845aa8cd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.430011 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e511490c0f8438fb89ac590bd63529f', 'request_id': 'req-2211a501-ab15-4443-ae2f-5c6e845aa8cd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.441860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] The token cache is being invalidate because project 8e511490c0f8438fb89ac590bd63529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:17:30.442175 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.442833 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.444392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1376/2740] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:17:29 2022] DELETE /identity/v3/projects/8e511490c0f8438fb89ac590bd63529f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:17:30.448365 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:30.449788 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:30.463762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b94f-2e06-4722-8294-8afc9964b6d2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:30.526192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:30.527406 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:30.527684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:30.527956 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] PATH_INFO: `/v3/users/c26f7377a97644c9830190f41db9ec35` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:30.529244 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26f7377a97644c9830190f41db9ec35)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:30.531241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:30.713173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26f7377a97644c9830190f41db9ec35'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.724315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:30.727395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26f7377a97644c9830190f41db9ec35'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.728097 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26f7377a97644c9830190f41db9ec35'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.735319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26f7377a97644c9830190f41db9ec35'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.735991 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26f7377a97644c9830190f41db9ec35'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:30.842005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1365/2741] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:17:30 2022] DELETE /identity/v3/users/c26f7377a97644c9830190f41db9ec35 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:17:31.123822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:17:31.125587 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:17:31.147832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211a501-ab15-4443-ae2f-5c6e845aa8cd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:17:31.185792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:31.209774 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:17:31.211248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:17:31.211699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:17:31.211823 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] PATH_INFO: `/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:17:31.213003 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e5f9a52ba444c9aeec8d8f0ac5e5fe)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:17:31.214945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:17:31.331801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e5f9a52ba444c9aeec8d8f0ac5e5fe', 'request_id': 'req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:31.389216 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e5f9a52ba444c9aeec8d8f0ac5e5fe', 'request_id': 'req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:31.394999 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e5f9a52ba444c9aeec8d8f0ac5e5fe', 'request_id': 'req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:31.407574 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] The token cache is being invalidate because project e1e5f9a52ba444c9aeec8d8f0ac5e5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:17:31.407909 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:31.408605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:17:31.410354 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1377/2742] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:17:31 2022] DELETE /identity/v3/projects/e1e5f9a52ba444c9aeec8d8f0ac5e5fe => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:17:41.046431 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:17:41.404284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:08.401567 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:18:08.403038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:08.502673 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100b315-522b-47d6-9a5c-dcdecc6e4e37 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:18:08.564460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:18:08.565111 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:08.565394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:08.565672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:08.567474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:08.624351 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:18:08.625962 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:18:08.634970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1366/2743] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:18:18.630800 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:18.702428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:18:18.702428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:18.774414 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb171-8526-4fbe-8e82-8f5ff3aea55e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:18:18.778825 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:18:18.779686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:18.779961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:18.780228 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] PATH_INFO: `/v3/users/19f6c089e7ec4ca5914d760e742d89b3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:18.781396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f6c089e7ec4ca5914d760e742d89b3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:18:18.783330 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:18:18.944563 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f6c089e7ec4ca5914d760e742d89b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:18.957690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f6c089e7ec4ca5914d760e742d89b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:18.963395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f6c089e7ec4ca5914d760e742d89b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:18.965643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f6c089e7ec4ca5914d760e742d89b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:18.966315 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f6c089e7ec4ca5914d760e742d89b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.044788 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1378/2744] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:18:18 2022] DELETE /identity/v3/users/19f6c089e7ec4ca5914d760e742d89b3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:18:19.246832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:18:19.258022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89cd61-88e0-47b8-8eb9-f65eefac019c service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:18:19.315608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:18:19.316464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:19.316740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:19.317009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] PATH_INFO: `/v3/projects/329e95cbfdb9493d82941bc00dd1ccbe` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:19.318214 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329e95cbfdb9493d82941bc00dd1ccbe)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:18:19.320072 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:18:19.434932 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329e95cbfdb9493d82941bc00dd1ccbe', 'request_id': 'req-82124fce-e02c-4d45-982f-f1903d84a3d0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.441324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329e95cbfdb9493d82941bc00dd1ccbe', 'request_id': 'req-82124fce-e02c-4d45-982f-f1903d84a3d0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.447064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329e95cbfdb9493d82941bc00dd1ccbe', 'request_id': 'req-82124fce-e02c-4d45-982f-f1903d84a3d0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.535147 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] The token cache is being invalidate because project 329e95cbfdb9493d82941bc00dd1ccbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:18:19.535364 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.535968 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:18:19.537518 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1367/2745] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:18:19 2022] DELETE /identity/v3/projects/329e95cbfdb9493d82941bc00dd1ccbe => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:18:20.512993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:18:20.514424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:20.568666 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ac19-d0d3-44c5-b087-c3a3aa08a45b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:18:20.599698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:20.615428 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:18:20.616063 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:20.616368 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:20.616641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:20.619068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:20.688905 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:18:20.690367 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a26577-a96f-45f8-9159-1d388c093945 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:18:20.701190 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1379/2746] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:18:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:18:21.878026 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:18:21.879535 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:21.892621 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82124fce-e02c-4d45-982f-f1903d84a3d0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:18:21.896187 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:18:21.896836 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:21.897119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:21.897394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:21.899177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:21.913538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:18:21.915010 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:18:21.926013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1368/2747] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:18:27.490942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:18:27.491467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:18:27.491576 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:18:27.508798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] MFA Rules not processed for user `8efe37a6d57b4775b4e47a295c3f5eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:18:27.509962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:18:27.563605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1380/2748] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:18:31.921102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:18:37.557184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=63 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:09.878562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:19:09.880038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:09.891135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6494ab-a34e-46a1-85e5-a225e0ca7bc8 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:19:09.894708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:19:09.895345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:19:09.895634 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:19:09.895910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:19:09.897624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:09.906809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:19:09.908218 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:19:09.916116 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1369/2749] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:19:14.081371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:19:14.091565 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3d2e-3954-4d56-9264-af5d74799b54 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:19:14.095107 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:19:14.095764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:19:14.096046 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:19:14.096324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:19:14.098153 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:14.107726 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:19:14.109150 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:19:14.117134 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1381/2750] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:19:14.197387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:19:14.205848 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647e98-87c4-42b6-a61b-6f9ef09a6900 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:19:14.210368 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:19:14.211007 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:19:14.211341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:19:14.211566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:19:14.213358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:14.226553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:19:14.227963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:19:14.240950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1370/2751] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:19:14.298480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:19:14.299862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:14.366544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999118-d3b8-4743-9dbe-8c58ce716a1a service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:19:14.371434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:19:14.372068 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:19:14.372345 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:19:14.372619 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:19:14.374353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:14.385748 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:19:14.387336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:19:14.396818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1382/2752] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:19:24.233914 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=12 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:24.392757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=38 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:19:27.750274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:19:27.751719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:27.765614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798340f0-9f7a-4262-a305-a932fa935d2e service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:19:27.771050 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:19:27.771682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:19:27.772625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:19:27.772903 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:19:27.774628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:19:27.786375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:19:27.788056 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:19:27.799164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1371/2753] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:19:37.795176 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:07.755249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:07.764973 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de108ce-7222-4721-b09d-614b85e5cd72 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:07.768663 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:07.769304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:07.769583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:07.769859 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:07.771639 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:07.833176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:07.834677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:07.843976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1383/2754] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:11.394405 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:11.395853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:11.410085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e712-6ed6-4e39-904b-a382c54c2635 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:11.415189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:11.416061 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:11.416407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:11.416686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] PATH_INFO: `/v3/users/8efe37a6d57b4775b4e47a295c3f5eee` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:11.417883 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efe37a6d57b4775b4e47a295c3f5eee)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:11.419796 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:11.600999 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efe37a6d57b4775b4e47a295c3f5eee'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:11.612589 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efe37a6d57b4775b4e47a295c3f5eee'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:11.613246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efe37a6d57b4775b4e47a295c3f5eee'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:11.620143 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efe37a6d57b4775b4e47a295c3f5eee'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:11.620785 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0100a20a-3bcd-4fd2-a45f-9c420775eda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efe37a6d57b4775b4e47a295c3f5eee'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:11.697024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1372/2755] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:11 2022] DELETE /identity/v3/users/8efe37a6d57b4775b4e47a295c3f5eee => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:11.931464 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:11.937064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331bb6-07b0-4110-b68a-a58edaec6529 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:11.991425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:11.992808 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:11.993109 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:11.993382 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] PATH_INFO: `/v3/projects/69b2364f40d14160adf0220d92adaad7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:11.994566 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b2364f40d14160adf0220d92adaad7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:11.996656 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.080605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b2364f40d14160adf0220d92adaad7', 'request_id': 'req-08cac912-cf8a-41e2-ae45-6c4cf1819602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:12.131099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b2364f40d14160adf0220d92adaad7', 'request_id': 'req-08cac912-cf8a-41e2-ae45-6c4cf1819602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:12.137547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b2364f40d14160adf0220d92adaad7', 'request_id': 'req-08cac912-cf8a-41e2-ae45-6c4cf1819602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:12.149177 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] The token cache is being invalidate because project 69b2364f40d14160adf0220d92adaad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:12.149465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:12.150152 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-08cac912-cf8a-41e2-ae45-6c4cf1819602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:12.151687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1384/2756] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:11 2022] DELETE /identity/v3/projects/69b2364f40d14160adf0220d92adaad7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:12.156708 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.156940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.157246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.214562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:12.215773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:12.273595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1373/2757] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:12.281452 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.281741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.282090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.300651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:12.301846 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:12.310594 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1385/2758] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:20:12.314638 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.324087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa028da0-2b0a-4342-b0a1-5de5b30d795b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.328484 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.329128 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.329407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.329680 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.330439 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:12.330745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.332315 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.343650 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1374/2759] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:20:12.347657 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.357269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04384fc-f6d9-4dd6-a8cd-c3df9e6afd0f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.362075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.362722 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.363007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.363286 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.363978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.365855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.379989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:12.493137 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1386/2760] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:12 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:12.497347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.507437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57fa6-d258-4872-a886-91deb18ebb82 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.532730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:12.563189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.563850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.564132 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.564446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.565135 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.567062 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.669081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1375/2761] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:12 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:12.673365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.684677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735331e0-c18b-4b86-9143-a370cafde2fa admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.689297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.689983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.690272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.690550 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.691333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.692967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.703467 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1387/2762] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:12.707379 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.717691 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a1b2-ad22-49df-bf27-9f48fd53fae6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.722250 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.722887 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.723170 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.723447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.724194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.725884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27639d-5edf-419b-b693-1c26a151ad0f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.737122 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1376/2763] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:20:12.741264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.751162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9765dc6-340c-4f88-9517-ac058f242379 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:12.755673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:12.756542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.756826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.757100 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] PATH_INFO: `/v3/projects/9a36f704338c4c968e1d1a477d89eb70/users/26766ede0aa24b229a290364b50662bb/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.771082 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a36f704338c4c968e1d1a477d89eb70, user_id=26766ede0aa24b229a290364b50662bb, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:12.774241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:12.880406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1388/2764] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:12 2022] PUT /identity/v3/projects/9a36f704338c4c968e1d1a477d89eb70/users/26766ede0aa24b229a290364b50662bb/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:12.891321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:12.891641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:12.891926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:12.918647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] MFA Rules not processed for user `26766ede0aa24b229a290364b50662bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:12.919854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:12.982493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1377/2765] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:20:12.992961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:12.994753 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:13.069106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79c5c-3867-466e-a855-1cd719763ea5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:13.073381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:13.074074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:13.074362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:13.074641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:13.082821 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:13.084242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852416a4-d7f5-4b37-b1f0-6c98d3b62692 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:13.093380 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1389/2766] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:22.778746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:22.840923 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf939f-ad84-4961-b34c-ec66be2118cf None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:22.845358 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:22.846254 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:22.846539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:22.846815 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] PATH_INFO: `/v3/users/26766ede0aa24b229a290364b50662bb` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:22.847993 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26766ede0aa24b229a290364b50662bb)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:22.849884 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:23.062506 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:23.068106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26766ede0aa24b229a290364b50662bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:23.080280 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26766ede0aa24b229a290364b50662bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:23.080926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26766ede0aa24b229a290364b50662bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:23.087603 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26766ede0aa24b229a290364b50662bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:23.088765 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26766ede0aa24b229a290364b50662bb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:23.093396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:23.175828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1378/2767] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:22 2022] DELETE /identity/v3/users/26766ede0aa24b229a290364b50662bb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:23.180191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:23.180510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:23.180839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:23.199741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:23.200920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:23.256234 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1390/2768] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:23.266474 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:23.267875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:23.324629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e8d20-159f-46ed-8ef6-f4f1ba1dd8e4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:23.328253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:23.328902 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:23.329184 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:23.329459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:23.338340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:23.339740 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b346449-c89c-4479-a3a2-3d8eccbaaf12 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:23.349044 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1379/2769] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:20:23.874338 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:23.875790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:23.889691 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e00a3b-3e1d-4439-86d1-47b99500777d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:23.892173 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:23.893036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:23.893408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:23.893593 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] PATH_INFO: `/v3/projects/9a36f704338c4c968e1d1a477d89eb70` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:23.894815 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a36f704338c4c968e1d1a477d89eb70)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:23.896723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.011006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a36f704338c4c968e1d1a477d89eb70', 'request_id': 'req-72b472e6-63ed-4732-a04c-3444b4db9e8c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:24.078961 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a36f704338c4c968e1d1a477d89eb70', 'request_id': 'req-72b472e6-63ed-4732-a04c-3444b4db9e8c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:24.084554 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a36f704338c4c968e1d1a477d89eb70', 'request_id': 'req-72b472e6-63ed-4732-a04c-3444b4db9e8c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:24.095861 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] The token cache is being invalidate because project 9a36f704338c4c968e1d1a477d89eb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:24.096442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:24.096932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-72b472e6-63ed-4732-a04c-3444b4db9e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:24.098501 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1391/2770] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:23 2022] DELETE /identity/v3/projects/9a36f704338c4c968e1d1a477d89eb70 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:24.103387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.104547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.104547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.121724 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:24.122942 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:24.181688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1380/2771] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:24.189551 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.189844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.190271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.209151 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:24.210371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:24.218839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1392/2772] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:24.222854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.232726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296896e-252f-428a-a9ef-13495f942e7b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.237323 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.238013 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.238297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.238572 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.239301 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:24.239614 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.241230 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.252759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1381/2773] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:20:24.256685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.266089 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f13f-e58a-416e-bdac-903650b5c6a3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.270618 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.271263 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.271547 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.271824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.272529 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.274448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.382908 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1393/2774] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:24.387459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.397259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296185f-aa72-4904-98ba-1481b8eb22d2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.439959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:24.452952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.453626 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.453922 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.454206 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.454910 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.456823 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.524890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1382/2775] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:24.529608 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.539742 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0078dd-6356-4045-8ef3-b8b0dcb20b09 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.544470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.545136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.545420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.545725 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.546494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.552930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.558353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1394/2776] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:24.562204 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.573615 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b77e-2303-4929-beab-01ef973000df admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.578447 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.579130 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.579414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.579690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.580426 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.582046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b754-ca13-4d5e-8bc2-021f8e6adb45 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.592446 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1383/2777] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:24.596435 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.606334 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90da0ad-3ea2-4e58-a55d-f529670604dd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.610893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.611778 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.612037 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.612313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] PATH_INFO: `/v3/projects/6e33f77d98554ef59014aaa34e64c647/users/5a4f95a2adf44d4a8a8c6c11f7b536c2/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.627138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e33f77d98554ef59014aaa34e64c647, user_id=5a4f95a2adf44d4a8a8c6c11f7b536c2, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.629771 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.685019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1395/2778] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:24 2022] PUT /identity/v3/projects/6e33f77d98554ef59014aaa34e64c647/users/5a4f95a2adf44d4a8a8c6c11f7b536c2/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:24.695620 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.696539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.696539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.724345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] MFA Rules not processed for user `5a4f95a2adf44d4a8a8c6c11f7b536c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:24.725797 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:24.787396 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1384/2779] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:24.791936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.812804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:24.852511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224b69a-181d-4a74-b980-cd33e4f3c7df admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:24.857580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:24.858269 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:24.858553 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:24.858831 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:24.859518 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:24.861398 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:24.942887 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1396/2780] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:24.947081 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:24.958649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c75126-cb7a-4f41-aafa-b0adad0da84e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.012820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.013485 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.013832 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.016672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.016672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.016672 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.090790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1385/2781] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:24 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:25.094696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:25.105470 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1164f-7f05-480b-8bc7-b2816ca7eed2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.110091 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.110750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.111032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.111311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.112071 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.113660 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.125311 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1397/2782] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:25.129509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:25.140721 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0c19-a447-4853-907d-fad43b3b25f1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.144106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.144979 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.145263 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.145539 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] PATH_INFO: `/v3/projects/02d631d71cc14adaa630d62c8973945d/users/41a153ccaad846c9af1497e1abb2a02c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.160112 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d631d71cc14adaa630d62c8973945d, user_id=41a153ccaad846c9af1497e1abb2a02c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.162792 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.239216 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1386/2783] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:25 2022] PUT /identity/v3/projects/02d631d71cc14adaa630d62c8973945d/users/41a153ccaad846c9af1497e1abb2a02c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:25.243000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:25.253275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874949c7-bce0-40ab-b927-599c53e44711 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.307965 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.308627 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.308911 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.309187 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.309930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.311513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455e70-2e58-48d8-b208-411705cbbf6e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.321544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1398/2784] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:25.325756 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:25.335989 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974326-a185-4e70-8b76-729e81c7ef18 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.340531 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.341412 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.341696 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.342008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] PATH_INFO: `/v3/projects/02d631d71cc14adaa630d62c8973945d/users/41a153ccaad846c9af1497e1abb2a02c/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.343987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d631d71cc14adaa630d62c8973945d, user_id=41a153ccaad846c9af1497e1abb2a02c, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.346623 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.357142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1387/2785] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:25 2022] PUT /identity/v3/projects/02d631d71cc14adaa630d62c8973945d/users/41a153ccaad846c9af1497e1abb2a02c/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:25.368343 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.368636 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.368940 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.394844 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] MFA Rules not processed for user `41a153ccaad846c9af1497e1abb2a02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:25.396058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:25.461877 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1399/2786] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:25.473341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:25.475035 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:25.485460 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:25.532345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68893f-ca49-4c27-b4e5-b6bb44abd174 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:25.535985 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:25.536625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:25.536928 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:25.537177 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:25.547142 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:25.548550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e920e6-21ad-4350-9cdc-265fe733d895 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:25.557840 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1388/2787] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:26.364066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:26.380990 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:26.424935 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c172399-330c-4bdb-823e-c2ebdfd44170 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:26.429442 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:26.430350 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:26.430628 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:26.430898 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] PATH_INFO: `/v3/users/5a4f95a2adf44d4a8a8c6c11f7b536c2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:26.432106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4f95a2adf44d4a8a8c6c11f7b536c2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:26.434166 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:26.662546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4f95a2adf44d4a8a8c6c11f7b536c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:26.674168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4f95a2adf44d4a8a8c6c11f7b536c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:26.674835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4f95a2adf44d4a8a8c6c11f7b536c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:26.681600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4f95a2adf44d4a8a8c6c11f7b536c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:26.682318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4f95a2adf44d4a8a8c6c11f7b536c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:26.757084 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1400/2788] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:26 2022] DELETE /identity/v3/users/5a4f95a2adf44d4a8a8c6c11f7b536c2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:26.762154 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:26.768011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:26.768011 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:26.780017 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:26.781194 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:26.839118 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1389/2789] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:26.848792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:26.850225 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:26.905913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888738f2-2d58-4097-8cd3-bcf30c0b0d61 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:26.909449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:26.910117 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:26.910406 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:26.910685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:26.919532 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:26.920900 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:26.930183 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1401/2790] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:27.327229 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:27.328803 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:27.341521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ccf72-9cff-4230-a008-9e2e402f61be None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:27.346110 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:27.346982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:27.347270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:27.351171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] PATH_INFO: `/v3/projects/6e33f77d98554ef59014aaa34e64c647` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:27.351171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e33f77d98554ef59014aaa34e64c647)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:27.351171 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:27.479635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e33f77d98554ef59014aaa34e64c647', 'request_id': 'req-d3059ee8-408f-4d2f-9a04-4fa1134da109'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.485653 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e33f77d98554ef59014aaa34e64c647', 'request_id': 'req-d3059ee8-408f-4d2f-9a04-4fa1134da109'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.491253 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e33f77d98554ef59014aaa34e64c647', 'request_id': 'req-d3059ee8-408f-4d2f-9a04-4fa1134da109'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.576283 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] The token cache is being invalidate because project 6e33f77d98554ef59014aaa34e64c647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:27.576571 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.577191 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.578771 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1390/2791] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:27 2022] DELETE /identity/v3/projects/6e33f77d98554ef59014aaa34e64c647 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:27.582764 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:27.592847 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1746-b74f-4373-af76-94a32d6f52fe service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:27.625511 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:27.647916 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:27.648782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:27.649235 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:27.649720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] PATH_INFO: `/v3/users/41a153ccaad846c9af1497e1abb2a02c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:27.651348 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a153ccaad846c9af1497e1abb2a02c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:27.653299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:27.783250 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a153ccaad846c9af1497e1abb2a02c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.795277 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a153ccaad846c9af1497e1abb2a02c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.795942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a153ccaad846c9af1497e1abb2a02c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.802962 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a153ccaad846c9af1497e1abb2a02c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.803723 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-526524b5-6dbc-4ddd-a8bd-aff1fd7660de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a153ccaad846c9af1497e1abb2a02c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:27.877157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1402/2792] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:27 2022] DELETE /identity/v3/users/41a153ccaad846c9af1497e1abb2a02c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:28.292502 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:28.294071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:28.307855 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059ee8-408f-4d2f-9a04-4fa1134da109 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:28.338268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:28.363550 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:28.366145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.366145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.366145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] PATH_INFO: `/v3/projects/02d631d71cc14adaa630d62c8973945d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.366145 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d631d71cc14adaa630d62c8973945d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:28.367987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:28.488845 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d631d71cc14adaa630d62c8973945d', 'request_id': 'req-094accee-c766-4aa7-a947-154df4efbf52'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:28.494953 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d631d71cc14adaa630d62c8973945d', 'request_id': 'req-094accee-c766-4aa7-a947-154df4efbf52'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:28.500835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d631d71cc14adaa630d62c8973945d', 'request_id': 'req-094accee-c766-4aa7-a947-154df4efbf52'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:28.575583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] The token cache is being invalidate because project 02d631d71cc14adaa630d62c8973945d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:28.575805 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:28.576422 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-094accee-c766-4aa7-a947-154df4efbf52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:28.578009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1391/2793] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:28 2022] DELETE /identity/v3/projects/02d631d71cc14adaa630d62c8973945d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:28.582868 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.583384 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.583502 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.601099 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:28.603080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:28.660131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1403/2794] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:28.668475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.668768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.669052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.687034 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:28.688228 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:28.696494 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1392/2795] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:28.700604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:28.710064 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00051a5d-5b2a-4331-92c3-7cff66e2940a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:28.715110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:28.715760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.716048 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.716331 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.717061 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:28.717371 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:28.718989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:28.730783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1404/2796] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:20:28.734894 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:28.744677 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf9de9-5afd-46fc-acf2-dda15fba94bd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:28.749645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:28.750331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.750613 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.750885 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.751582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:28.753473 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:28.869410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1393/2797] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:28 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:28.880031 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:28.890391 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417518-bde7-4e55-b8cb-ae6908ebd8e5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:28.930086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:28.944189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:28.944853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:28.945138 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:28.945415 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:28.946144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:28.948546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.050325 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1405/2798] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:28 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:29.054505 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.064828 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875b4ae-f426-4b7d-9b95-2d014d0c31c6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.069744 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.070486 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.070774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.071052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.071789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.073876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.084258 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1394/2799] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:29.092053 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.101702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66e0b-fe28-4f25-ae9f-921264cd7b43 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.106240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.106956 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.107241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.107520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.108251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.109827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454f6ca-ebef-46ea-ac8c-45131b3f50f0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.120651 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1406/2800] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:29.124389 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.134221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0583d-5214-4ade-b91f-dc64b89c07d1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.139641 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.140517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.140801 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.141079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] PATH_INFO: `/v3/projects/5133c836220749b5ba508decf243f34c/users/5aa4f0105cac4a3e959f0f520a8e9279/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.156521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5133c836220749b5ba508decf243f34c, user_id=5aa4f0105cac4a3e959f0f520a8e9279, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.159173 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.232781 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1395/2801] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:29 2022] PUT /identity/v3/projects/5133c836220749b5ba508decf243f34c/users/5aa4f0105cac4a3e959f0f520a8e9279/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:29.244637 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.244936 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.245218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.271732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] MFA Rules not processed for user `5aa4f0105cac4a3e959f0f520a8e9279`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:29.272959 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:29.341682 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1407/2802] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:29.346139 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.406319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b99f8-4aa3-43e6-afb6-8e27de6da2bf admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.410780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.411424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.411706 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.411982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.412664 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.414577 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.417669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:29.486021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1396/2803] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:29 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:29.490240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.501461 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6ef7c-787e-40ae-ba2f-5cae841eb4cc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.557997 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.558664 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.558945 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.559219 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.559906 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.561801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.610395 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1408/2804] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:29 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:29.614443 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.625198 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307a182-8839-457d-81e8-f6bf13e5f85a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.629755 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.630448 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.630727 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.630998 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.631743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.633307 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.643628 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1397/2805] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:29.647652 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.657510 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deccd07-54aa-40d6-bbc1-55db063895d6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.662001 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.662865 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.663148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.663438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] PATH_INFO: `/v3/projects/bfd33725a1b744babc536f43ad055f4c/users/431a64794b834ddca6e1d003df6e9ca9/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.678240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd33725a1b744babc536f43ad055f4c, user_id=431a64794b834ddca6e1d003df6e9ca9, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.680860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.787731 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1409/2806] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:29 2022] PUT /identity/v3/projects/bfd33725a1b744babc536f43ad055f4c/users/431a64794b834ddca6e1d003df6e9ca9/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:29.792299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.802647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd47d9-0f9b-444f-8821-6ffcf93d8bc8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.858312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.858967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.859248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.859521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.860235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.861793 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa3700-96d4-495d-9429-80d56a1d42ac admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.872014 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1398/2807] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:20:29.876272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:29.886329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adb9fd-3d32-4d19-b8b6-6499e6ec48a2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:29.890818 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:29.891687 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.891970 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.892244 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] PATH_INFO: `/v3/projects/bfd33725a1b744babc536f43ad055f4c/users/431a64794b834ddca6e1d003df6e9ca9/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.894218 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd33725a1b744babc536f43ad055f4c, user_id=431a64794b834ddca6e1d003df6e9ca9, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:29.896826 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:29.907266 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1410/2808] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:29 2022] PUT /identity/v3/projects/bfd33725a1b744babc536f43ad055f4c/users/431a64794b834ddca6e1d003df6e9ca9/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:29.967265 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:29.967547 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:29.967816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:29.994083 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] MFA Rules not processed for user `431a64794b834ddca6e1d003df6e9ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:29.995277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:30.061517 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1399/2809] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:30.072732 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:30.074537 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:30.081106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:30.130741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173dbdd-c939-45d4-b0c5-d091fa346587 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:30.134303 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:30.134957 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:30.135237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:30.135514 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:30.144182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:30.145585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae6c72-77f6-4ab8-918c-ca3e45287061 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:30.155204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1411/2810] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:30.182760 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:30.239371 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:30.244733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fafc65-3d37-401a-bcc9-e6059a3a8186 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:30.249312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:30.250211 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:30.250493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:30.250770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] PATH_INFO: `/v3/users/5aa4f0105cac4a3e959f0f520a8e9279` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:30.251965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa4f0105cac4a3e959f0f520a8e9279)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:30.253859 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:30.475467 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa4f0105cac4a3e959f0f520a8e9279'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:30.487414 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa4f0105cac4a3e959f0f520a8e9279'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:30.488091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa4f0105cac4a3e959f0f520a8e9279'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:30.495049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa4f0105cac4a3e959f0f520a8e9279'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:30.495619 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa4f0105cac4a3e959f0f520a8e9279'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:30.564342 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1400/2811] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:30 2022] DELETE /identity/v3/users/5aa4f0105cac4a3e959f0f520a8e9279 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:30.568822 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:30.569362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:30.569642 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:30.586647 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:30.589710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:30.645845 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1412/2812] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:30.655456 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:30.656850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:30.714232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f434-12ac-433f-8958-0411ff84590b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:30.717816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:30.718489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:30.718773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:30.719049 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:30.728226 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:30.730588 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:30.739117 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1401/2813] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 21:20:31.107888 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:31.109308 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:31.121760 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109707-cf90-411d-8369-59e3b4afadc8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:31.126237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:31.127101 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:31.127449 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:31.127707 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] PATH_INFO: `/v3/projects/5133c836220749b5ba508decf243f34c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:31.128882 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5133c836220749b5ba508decf243f34c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:31.130816 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:31.231617 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5133c836220749b5ba508decf243f34c', 'request_id': 'req-4b27ec8f-74b8-4aa4-bc51-925b1202024f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.288661 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5133c836220749b5ba508decf243f34c', 'request_id': 'req-4b27ec8f-74b8-4aa4-bc51-925b1202024f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.294904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5133c836220749b5ba508decf243f34c', 'request_id': 'req-4b27ec8f-74b8-4aa4-bc51-925b1202024f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.306098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] The token cache is being invalidate because project 5133c836220749b5ba508decf243f34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:31.306381 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.306998 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.309108 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1413/2814] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:31 2022] DELETE /identity/v3/projects/5133c836220749b5ba508decf243f34c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:31.313241 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:31.323442 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99eae-d0fb-452c-9b99-39f24919501b service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:31.379440 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:31.380225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:31.380504 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:31.380776 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] PATH_INFO: `/v3/users/431a64794b834ddca6e1d003df6e9ca9` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:31.381970 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431a64794b834ddca6e1d003df6e9ca9)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:31.383857 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:31.404425 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:31.593820 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431a64794b834ddca6e1d003df6e9ca9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.605606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431a64794b834ddca6e1d003df6e9ca9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.606270 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431a64794b834ddca6e1d003df6e9ca9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.613395 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431a64794b834ddca6e1d003df6e9ca9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.614087 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c4937731-75aa-44e4-bdef-a265f29b7e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431a64794b834ddca6e1d003df6e9ca9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:31.705733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1402/2815] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:31 2022] DELETE /identity/v3/users/431a64794b834ddca6e1d003df6e9ca9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:32.103370 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.105373 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:32.118491 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27ec8f-74b8-4aa4-bc51-925b1202024f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.147674 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:32.175336 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.176193 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.176474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.176747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] PATH_INFO: `/v3/projects/bfd33725a1b744babc536f43ad055f4c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.177968 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd33725a1b744babc536f43ad055f4c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.179858 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.261480 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd33725a1b744babc536f43ad055f4c', 'request_id': 'req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:32.301420 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd33725a1b744babc536f43ad055f4c', 'request_id': 'req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:32.307049 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd33725a1b744babc536f43ad055f4c', 'request_id': 'req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:32.318474 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] The token cache is being invalidate because project bfd33725a1b744babc536f43ad055f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:32.320148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:32.320148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b112c4dc-c859-48ad-9bb6-a4b8f4ae7d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:32.321168 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1414/2816] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:32 2022] DELETE /identity/v3/projects/bfd33725a1b744babc536f43ad055f4c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:32.326245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.326543 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.326825 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.345099 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:32.346332 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:32.404731 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1403/2817] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:32.412313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.412600 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.412907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.431582 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:32.432765 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:32.440615 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1415/2818] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:32.444955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.454835 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f039e0-b093-46d0-b139-f4a9ac7c5478 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.459305 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.459948 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.460232 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.460508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.461235 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:32.461544 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.463157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.475150 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1404/2819] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:20:32.479066 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.487852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a587d8e-7e48-4576-808a-7fcc9ef74f35 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.492359 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.492994 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.493272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.493544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.494255 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.496149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.576645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1416/2820] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:32.580676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.591266 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d3b8f-3ae7-4bae-a7f7-e317d6500645 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.646562 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.647292 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.647573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.647854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.648536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.650459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.734905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1405/2821] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:32.739110 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.749258 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6750c9-2263-40e0-bff3-2c1182afe32a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.753785 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.754479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.754766 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.755047 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.755769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.757378 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.768157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1417/2822] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:32.771959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.782452 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d384c-324d-44a8-83c7-5a84d380b990 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.787423 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.788127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.788410 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.788686 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.789424 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.791080 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd67af-2399-4c9b-8703-fb4e2f634f8e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.801548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1406/2823] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:32.805645 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:32.815437 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59bbb-75dd-4ef8-b68b-35a656cfc2db admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:32.820264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:32.821176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.821460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.821734 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] PATH_INFO: `/v3/projects/6281c1bee94f485eb2d79fab5bc4cf5f/users/96664b9266d84c17a59b90c1c4d71823/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.836265 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6281c1bee94f485eb2d79fab5bc4cf5f, user_id=96664b9266d84c17a59b90c1c4d71823, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:32.839533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:32.883918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1418/2824] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:32 2022] PUT /identity/v3/projects/6281c1bee94f485eb2d79fab5bc4cf5f/users/96664b9266d84c17a59b90c1c4d71823/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:32.895772 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:32.896064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:32.896341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:32.902144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:32.922768 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] MFA Rules not processed for user `96664b9266d84c17a59b90c1c4d71823`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:32.923976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:32.987607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1407/2825] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:32.992246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.048720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:33.052274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f36532-a0a0-46f7-b15e-58aac3529625 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.056853 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.058131 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.058413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.058717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.059412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.061299 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.141770 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1419/2826] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:32 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:33.145853 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.156331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0c15b-8d13-48cc-8073-5ec02a459b70 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.211959 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.212633 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.212958 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.213245 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.213984 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.215955 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.317208 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1408/2827] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:33 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:33.321413 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.331737 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b2b2-b104-4970-ae7f-43c62be248b3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.336249 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.336904 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.337184 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.337460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.338220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.339913 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.350241 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1420/2828] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:33.354688 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.364682 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ce6a6-4271-41ca-a122-a654f84421a0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.369546 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.371052 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.371334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.371607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] PATH_INFO: `/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad/users/848603a405ae40bebf63f29d05850f0f/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.385941 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6a5cd93fea4055ad411ee6c1343fad, user_id=848603a405ae40bebf63f29d05850f0f, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.388578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.490069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1409/2829] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:33 2022] PUT /identity/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad/users/848603a405ae40bebf63f29d05850f0f/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:33.494074 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.504513 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef710-d2b3-40a2-a011-4ef1fad4a5f7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.558327 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.558987 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.559264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.559533 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.560272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.561835 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647288b-9f0b-4c22-be89-6795587bbd91 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.571564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1421/2830] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:33.576831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.587268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6b9a8-093f-4dae-a7ec-cb1b56be4ed4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.592537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.593408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.593694 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.594019 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] PATH_INFO: `/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad/users/848603a405ae40bebf63f29d05850f0f/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.596018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6a5cd93fea4055ad411ee6c1343fad, user_id=848603a405ae40bebf63f29d05850f0f, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.598689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.609624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1410/2831] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:33 2022] PUT /identity/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad/users/848603a405ae40bebf63f29d05850f0f/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:33.619840 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.620162 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.620473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.646741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] MFA Rules not processed for user `848603a405ae40bebf63f29d05850f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:33.647948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:33.716204 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1422/2832] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 21:20:33.727537 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.729963 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:33.775274 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:33.786221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a8f5-2644-40ca-9434-d7fee5823ced admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.790024 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.790675 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.790961 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.791239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.801101 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.802574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.812684 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1411/2833] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:33.910010 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:33.920272 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2278ba2-2c27-4ea7-b762-0001312415f7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:33.923805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:33.924438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:33.924720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:33.924996 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:33.971702 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:33.980075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:33.986942 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966208-b2e1-46c6-b6a5-76ae3202cf3a service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:33.990242 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1423/2834] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:37.013373 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:37.076519 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433001-9f25-4639-af63-0b5770e42860 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:37.080973 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:37.081846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:37.082199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:37.082466 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] PATH_INFO: `/v3/users/96664b9266d84c17a59b90c1c4d71823` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:37.083643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96664b9266d84c17a59b90c1c4d71823)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:37.085578 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:37.244582 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96664b9266d84c17a59b90c1c4d71823'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:37.256511 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96664b9266d84c17a59b90c1c4d71823'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:37.257169 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96664b9266d84c17a59b90c1c4d71823'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:37.264548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96664b9266d84c17a59b90c1c4d71823'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:37.265172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96664b9266d84c17a59b90c1c4d71823'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:37.339707 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1412/2835] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:37 2022] DELETE /identity/v3/users/96664b9266d84c17a59b90c1c4d71823 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:37.344237 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:37.344790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:37.344790 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:37.362116 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:37.363318 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:37.422196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1424/2836] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:37.431742 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:37.433129 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:37.489289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67ba0-48c4-4713-a0d9-13b359b95dc3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:37.492906 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:37.493548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:37.493830 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:37.494138 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:37.503221 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:37.504649 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:37.513888 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1413/2837] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:37.913346 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:37.915254 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:37.931569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f504e-26f1-4ff6-aaa3-7cc6f542d6bb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:37.938542 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:37.939453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:37.939735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:37.940078 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] PATH_INFO: `/v3/projects/6281c1bee94f485eb2d79fab5bc4cf5f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:37.941392 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6281c1bee94f485eb2d79fab5bc4cf5f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:37.943448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:38.049767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6281c1bee94f485eb2d79fab5bc4cf5f', 'request_id': 'req-350d2054-f0a5-45b0-a7b8-61a7a743742c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.118683 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6281c1bee94f485eb2d79fab5bc4cf5f', 'request_id': 'req-350d2054-f0a5-45b0-a7b8-61a7a743742c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.124494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6281c1bee94f485eb2d79fab5bc4cf5f', 'request_id': 'req-350d2054-f0a5-45b0-a7b8-61a7a743742c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.135792 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] The token cache is being invalidate because project 6281c1bee94f485eb2d79fab5bc4cf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:38.136104 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.136735 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.138412 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1425/2838] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:37 2022] DELETE /identity/v3/projects/6281c1bee94f485eb2d79fab5bc4cf5f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:38.142407 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:38.151965 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c1f8-08b4-4558-9d65-0be55e301c68 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:38.157121 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:38.207070 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:38.207950 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:38.208233 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:38.208508 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] PATH_INFO: `/v3/users/848603a405ae40bebf63f29d05850f0f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:38.209697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=848603a405ae40bebf63f29d05850f0f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:38.211639 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:38.427521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848603a405ae40bebf63f29d05850f0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.439063 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848603a405ae40bebf63f29d05850f0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.439733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848603a405ae40bebf63f29d05850f0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.446773 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848603a405ae40bebf63f29d05850f0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.447394 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3e90f3c7-12bf-4eb6-9581-346e9ef209bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848603a405ae40bebf63f29d05850f0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:38.518338 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1414/2839] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:38 2022] DELETE /identity/v3/users/848603a405ae40bebf63f29d05850f0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:38.920920 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:38.922457 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:38.942867 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2054-f0a5-45b0-a7b8-61a7a743742c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.001508 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.002396 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.002680 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.002955 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] PATH_INFO: `/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.004119 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6a5cd93fea4055ad411ee6c1343fad)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.006189 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.022976 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:39.147106 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6a5cd93fea4055ad411ee6c1343fad', 'request_id': 'req-0f75217e-be97-4f3a-a365-28015c9fe9bb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:39.227178 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6a5cd93fea4055ad411ee6c1343fad', 'request_id': 'req-0f75217e-be97-4f3a-a365-28015c9fe9bb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:39.233019 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6a5cd93fea4055ad411ee6c1343fad', 'request_id': 'req-0f75217e-be97-4f3a-a365-28015c9fe9bb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:39.244041 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] The token cache is being invalidate because project 5f6a5cd93fea4055ad411ee6c1343fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:39.244326 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:39.244948 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0f75217e-be97-4f3a-a365-28015c9fe9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:39.246571 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1426/2840] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:38 2022] DELETE /identity/v3/projects/5f6a5cd93fea4055ad411ee6c1343fad => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:39.251433 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.251890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.251995 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.271334 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:39.272521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:39.331512 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1415/2841] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:39.339425 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.339714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.339993 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.358479 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:39.359686 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:39.367498 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1427/2842] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:39.371459 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.381759 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f751-4ef1-49a2-82f6-050b6f2d53d8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.386355 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.387002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.387281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.387617 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.388339 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:39.388642 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.390269 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.402068 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1416/2843] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:20:39.406638 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.415609 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a453437-c6ca-441b-99e4-786099a1c029 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.421035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.421675 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.421995 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.422320 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.423006 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.424918 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.506603 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1428/2844] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:39 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:39.510843 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.520570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba32eec-9f77-4fc5-8678-dc290a8389c6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.532300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:39.576409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.577074 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.577356 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.577630 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.578346 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.580328 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.690038 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1417/2845] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:39 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:39.694434 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.705098 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb522a-d549-4b59-ad65-3b479b8df39f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.709992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.710641 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.710922 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.711198 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.711921 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.713494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.724862 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1429/2846] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:39.728631 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.739064 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3cc1d-7a91-4346-bda2-8b088ba0f22f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.743754 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.744409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.744693 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.744971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.745720 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.747337 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf3e4-4c90-45ce-be63-3b745d04269d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.757203 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1418/2847] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:20:39.761086 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:39.770610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40e0d-2e74-4eae-940c-7500c6d47c2b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:39.775070 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:39.775933 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.776212 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.776485 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] PATH_INFO: `/v3/projects/634e2d2e18f145d3ad693b7ad889763e/users/994a4e51e0e14cbeb1811e345cea842e/roles/ba84795116f349709142360a12649701` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.791879 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e2d2e18f145d3ad693b7ad889763e, user_id=994a4e51e0e14cbeb1811e345cea842e, role_id=ba84795116f349709142360a12649701)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:39.795907 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:39.906324 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1430/2848] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:39 2022] PUT /identity/v3/projects/634e2d2e18f145d3ad693b7ad889763e/users/994a4e51e0e14cbeb1811e345cea842e/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:39.917585 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:39.917871 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:39.918247 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:39.944067 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] MFA Rules not processed for user `994a4e51e0e14cbeb1811e345cea842e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:39.945261 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:40.007722 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1419/2849] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:40.012052 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.071819 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a158c-2d01-4e38-8a2a-2d161355118c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.076873 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.078039 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.078329 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.078606 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.079353 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.081239 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.192568 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1431/2850] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:40 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:40.197028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.208185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230abe8-d7c7-45ef-9c78-cba2914a2aee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.264489 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.265164 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.265401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.265676 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.266401 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.270420 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.381536 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1420/2851] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:40 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:40.385673 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.396896 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130fb5-c0b4-4f89-bf67-f5df1b0f757c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.401701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.402408 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.402685 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.402966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.404209 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.405798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.416200 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1432/2852] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:40.421005 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.430822 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00507df1-986b-4ab1-9ac5-5fd73e674108 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.435335 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.436209 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.436516 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.436931 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] PATH_INFO: `/v3/projects/be698d180a6e49ca898bdceb4fd42eb1/users/ed045aaab0ca4a24816d0d1c224f970d/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.448248 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:40.452312 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be698d180a6e49ca898bdceb4fd42eb1, user_id=ed045aaab0ca4a24816d0d1c224f970d, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.455077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.547398 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1421/2853] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:40 2022] PUT /identity/v3/projects/be698d180a6e49ca898bdceb4fd42eb1/users/ed045aaab0ca4a24816d0d1c224f970d/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:40.551186 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.561057 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcacc0f-7819-496d-9f9a-1312fcc4a39e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.572827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:40.616494 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.617160 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.617447 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.617728 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.618492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.620083 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b185-817c-4e96-8607-35de2fcc27b2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.629653 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1433/2854] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:40.633758 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.644608 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917317f8-870d-4e41-8877-995cdefaf698 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.649321 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.650256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.650540 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.650818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] PATH_INFO: `/v3/projects/be698d180a6e49ca898bdceb4fd42eb1/users/ed045aaab0ca4a24816d0d1c224f970d/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.652818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be698d180a6e49ca898bdceb4fd42eb1, user_id=ed045aaab0ca4a24816d0d1c224f970d, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.656125 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.666690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1422/2855] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:40 2022] PUT /identity/v3/projects/be698d180a6e49ca898bdceb4fd42eb1/users/ed045aaab0ca4a24816d0d1c224f970d/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:40.676783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.677075 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.677355 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.703832 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] MFA Rules not processed for user `ed045aaab0ca4a24816d0d1c224f970d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:40.705043 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:40.771509 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1434/2856] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:40.782625 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:40.784306 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:40.841219 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c112-7e49-4919-a1a7-3a9ffcb3b8a4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:40.844726 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:40.845375 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:40.845655 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:40.845966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:40.854831 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:40.856268 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a6f0-3549-4662-8e27-8c7b7d112aee service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:40.865513 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1423/2857] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:40.988363 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:41.048878 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879b9a-4978-4d35-8e0f-8c3f46490fff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:41.053323 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:41.054220 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:41.054504 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:41.054782 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] PATH_INFO: `/v3/users/994a4e51e0e14cbeb1811e345cea842e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:41.055958 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] RBAC: Authorizing `identity:delete_user(user_id=994a4e51e0e14cbeb1811e345cea842e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:41.057866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:41.227274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:41.233349 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994a4e51e0e14cbeb1811e345cea842e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:41.244787 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994a4e51e0e14cbeb1811e345cea842e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:41.245455 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994a4e51e0e14cbeb1811e345cea842e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:41.252739 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994a4e51e0e14cbeb1811e345cea842e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:41.253369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994a4e51e0e14cbeb1811e345cea842e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:41.334930 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1435/2858] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:40 2022] DELETE /identity/v3/users/994a4e51e0e14cbeb1811e345cea842e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:41.339669 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:41.340168 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:41.340277 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:41.357854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:41.361784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:41.416784 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1424/2859] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:41.426860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:41.428304 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:41.485146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da2b9f-6267-449a-b8d6-3225de76029d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:41.488786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:41.489431 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:41.489714 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:41.490020 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:41.499454 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:41.500866 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:41.510142 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1436/2860] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:41.937548 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:41.939172 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:41.951807 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7fbf-dd72-4737-89f5-2efba8131f47 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:41.956281 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:41.957185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:41.957464 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:41.957764 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] PATH_INFO: `/v3/projects/634e2d2e18f145d3ad693b7ad889763e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:41.958976 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=634e2d2e18f145d3ad693b7ad889763e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:41.960870 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:42.106324 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634e2d2e18f145d3ad693b7ad889763e', 'request_id': 'req-ba0b4f56-e309-4155-a831-15696fac23ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.112457 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634e2d2e18f145d3ad693b7ad889763e', 'request_id': 'req-ba0b4f56-e309-4155-a831-15696fac23ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.117987 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634e2d2e18f145d3ad693b7ad889763e', 'request_id': 'req-ba0b4f56-e309-4155-a831-15696fac23ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.186790 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] The token cache is being invalidate because project 634e2d2e18f145d3ad693b7ad889763e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:42.187079 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.187699 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.189239 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1425/2861] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:41 2022] DELETE /identity/v3/projects/634e2d2e18f145d3ad693b7ad889763e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:42.193143 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:42.202978 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395352a8-3e09-4f47-98a4-2100d098426b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:42.258740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:42.259570 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:42.259856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:42.260135 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] PATH_INFO: `/v3/users/ed045aaab0ca4a24816d0d1c224f970d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:42.261351 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed045aaab0ca4a24816d0d1c224f970d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:42.263297 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:42.423490 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed045aaab0ca4a24816d0d1c224f970d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.433746 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:42.436710 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed045aaab0ca4a24816d0d1c224f970d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.437544 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed045aaab0ca4a24816d0d1c224f970d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.444584 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed045aaab0ca4a24816d0d1c224f970d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.445229 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c300c09-a130-4084-a63d-f4baf7893853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed045aaab0ca4a24816d0d1c224f970d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:42.501097 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1437/2862] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:42 2022] DELETE /identity/v3/users/ed045aaab0ca4a24816d0d1c224f970d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:42.913947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:42.915383 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:42.925362 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:42.929652 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4f56-e309-4155-a831-15696fac23ac admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:42.985992 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:42.986854 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:42.987160 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:42.987415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] PATH_INFO: `/v3/projects/be698d180a6e49ca898bdceb4fd42eb1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:42.988606 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be698d180a6e49ca898bdceb4fd42eb1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:42.990553 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.084493 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be698d180a6e49ca898bdceb4fd42eb1', 'request_id': 'req-69866719-fe51-48c2-9d79-1e0c85a9eef9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:43.090437 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be698d180a6e49ca898bdceb4fd42eb1', 'request_id': 'req-69866719-fe51-48c2-9d79-1e0c85a9eef9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:43.096490 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be698d180a6e49ca898bdceb4fd42eb1', 'request_id': 'req-69866719-fe51-48c2-9d79-1e0c85a9eef9'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:43.185875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] The token cache is being invalidate because project be698d180a6e49ca898bdceb4fd42eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:43.186189 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:43.186834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-69866719-fe51-48c2-9d79-1e0c85a9eef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:43.188347 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1426/2863] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:42 2022] DELETE /identity/v3/projects/be698d180a6e49ca898bdceb4fd42eb1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:43.193213 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.193984 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.194090 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.212223 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:43.213417 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:43.271555 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1438/2864] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:43.279408 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.279697 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.279971 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.297777 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:43.299016 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:43.306770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1427/2865] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:43.311360 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.321032 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ac84-a070-426b-a698-1bcac8836069 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.325423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.326721 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.327000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.327273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.328123 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:43.328430 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.330035 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.341248 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1439/2866] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 21:20:43.345309 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.354403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d231-9bb2-4d87-b2f6-83068610a3f8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.358947 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.359595 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.359878 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.360155 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.360841 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.362762 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.434089 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1428/2867] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:43.438730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.449251 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87babecb-59fb-42f1-8768-65d1a7142f06 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.503804 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.504465 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.504750 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.505029 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.505713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.507644 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.564256 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1440/2868] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:43.568643 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.580023 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051ad8a-6f8e-4e7c-8949-069b8013c972 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.584629 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.585290 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.585574 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.585850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.586610 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.588196 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.598658 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1429/2869] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:43.602523 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.612483 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f5fc-613e-44ef-b096-d9955a26e498 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.617445 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.618136 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.618423 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.618698 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.619448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.621145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b8d8-adbf-46ef-a451-f59276a93698 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.631560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1441/2870] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:43.635521 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.646090 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab4d92-381f-46d9-b660-7a760c5bdd8b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.650730 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.651607 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.651890 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.652167 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] PATH_INFO: `/v3/projects/d36ec6c47ba24dfa8fdfd6125d49ec7b/users/d4b48b94362c4ceb8f8549410c41c653/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.666526 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36ec6c47ba24dfa8fdfd6125d49ec7b, user_id=d4b48b94362c4ceb8f8549410c41c653, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.669152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.735583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1430/2871] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:43 2022] PUT /identity/v3/projects/d36ec6c47ba24dfa8fdfd6125d49ec7b/users/d4b48b94362c4ceb8f8549410c41c653/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:43.746851 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.747146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.748115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.774306 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] MFA Rules not processed for user `d4b48b94362c4ceb8f8549410c41c653`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:43.775516 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:43.808379 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:43.840528 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1442/2872] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:43.845692 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:43.875763 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:43.906238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35a72-6995-4854-af91-a361d7e5b9ae admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:43.911403 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:43.912060 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:43.912343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:43.912622 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:43.913318 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:43.915246 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:43.987703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1431/2873] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:43.991794 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.002863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba3138-eb92-49de-807f-35ea4693f12a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.057522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.058231 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.058520 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.058805 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.059503 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.061983 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.147000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1443/2874] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:43 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:44.150921 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.161082 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df844f15-22ed-4ba8-9355-2f91d90f5b19 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.165967 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.166635 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.166920 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.167225 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.167988 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.169580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.180077 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1432/2875] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 21:20:44.186717 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.196810 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1b1d0-00f7-4a72-a1f1-d7d685bad7d7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.202236 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.203145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.203444 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.203713 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] PATH_INFO: `/v3/projects/025cf25956d74a808a38d008cd143cc9/users/3fde94fe375f4c5f97f45f762b079e57/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.218264 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025cf25956d74a808a38d008cd143cc9, user_id=3fde94fe375f4c5f97f45f762b079e57, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.220932 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.301761 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1444/2876] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:44 2022] PUT /identity/v3/projects/025cf25956d74a808a38d008cd143cc9/users/3fde94fe375f4c5f97f45f762b079e57/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:44.305656 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.316018 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97500d-3722-48c1-9d03-385a42f40476 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.372313 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.373468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.373751 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.374057 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.374775 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.376361 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdee930-f978-45d5-a980-5731faa18daf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.385809 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1433/2877] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:44.390512 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.400699 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef5e-49e6-4be8-a8c0-18e90e9f13d7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.405259 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.406157 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.406440 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.406715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] PATH_INFO: `/v3/projects/025cf25956d74a808a38d008cd143cc9/users/3fde94fe375f4c5f97f45f762b079e57/roles/95bfdf5b1a1643009d426b6b0d876130` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.408860 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=025cf25956d74a808a38d008cd143cc9, user_id=3fde94fe375f4c5f97f45f762b079e57, role_id=95bfdf5b1a1643009d426b6b0d876130)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.411527 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.422072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1445/2878] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:44 2022] PUT /identity/v3/projects/025cf25956d74a808a38d008cd143cc9/users/3fde94fe375f4c5f97f45f762b079e57/roles/95bfdf5b1a1643009d426b6b0d876130 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:44.431935 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0912-6156-4080-862c-8046039f7040 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.432222 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0912-6156-4080-862c-8046039f7040 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.436703 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e0912-6156-4080-862c-8046039f7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.458875 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f39e0912-6156-4080-862c-8046039f7040 None None] MFA Rules not processed for user `3fde94fe375f4c5f97f45f762b079e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:44.460078 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f39e0912-6156-4080-862c-8046039f7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:44.528509 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1434/2879] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:44.539850 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:44.541546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:44.598654 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9245a2-57bc-4d96-b107-fd310ba048ff admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:44.602271 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:44.602915 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:44.603262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:44.603548 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:44.645072 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:44.661132 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:44.662522 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:44.671144 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1446/2880] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:49.824006 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e0912-6156-4080-862c-8046039f7040 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:49.826046 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f39e0912-6156-4080-862c-8046039f7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:49.837798 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e0912-6156-4080-862c-8046039f7040 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:49.841934 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0773ba9f520f432c88ae86143c91b9f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:49.842566 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:49.842846 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:49.843119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:49.851743 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:49.853144 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479f4c-3154-4391-af02-09191001b2b5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:49.862325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1435/2881] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:54.706786 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:55.756814 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:55.819705 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf39b9-ca04-44aa-8a45-a86d9e663116 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:55.824191 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:55.825056 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:55.825337 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:55.825614 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] PATH_INFO: `/v3/users/d4b48b94362c4ceb8f8549410c41c653` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:55.826839 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b48b94362c4ceb8f8549410c41c653)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:55.828740 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:56.005139 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b48b94362c4ceb8f8549410c41c653'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.017058 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b48b94362c4ceb8f8549410c41c653'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.017727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b48b94362c4ceb8f8549410c41c653'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.024492 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b48b94362c4ceb8f8549410c41c653'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.025115 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b48b94362c4ceb8f8549410c41c653'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.100545 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1447/2882] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:55 2022] DELETE /identity/v3/users/d4b48b94362c4ceb8f8549410c41c653 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:56.105127 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:56.105599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:56.105713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:56.123715 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:56.124905 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:56.130199 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:56.183185 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1436/2883] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:56.192643 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:56.194358 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:56.249715 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cee6db-aa73-4b5c-b84c-9ce6cd4e931e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:56.253328 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:56.254000 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:56.254284 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:56.254564 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:56.263438 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:56.264801 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:56.274468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1448/2884] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:20:56.691136 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:56.692560 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:56.705719 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272825-c395-49bf-abb7-8be78ecc421e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:56.710700 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:56.711636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:56.712028 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:56.712310 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] PATH_INFO: `/v3/projects/d36ec6c47ba24dfa8fdfd6125d49ec7b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:56.713527 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36ec6c47ba24dfa8fdfd6125d49ec7b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:56.715563 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:56.833319 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36ec6c47ba24dfa8fdfd6125d49ec7b', 'request_id': 'req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.839488 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36ec6c47ba24dfa8fdfd6125d49ec7b', 'request_id': 'req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.844940 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36ec6c47ba24dfa8fdfd6125d49ec7b', 'request_id': 'req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.922576 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] The token cache is being invalidate because project d36ec6c47ba24dfa8fdfd6125d49ec7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:56.922860 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.923469 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:56.925069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1437/2885] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:56 2022] DELETE /identity/v3/projects/d36ec6c47ba24dfa8fdfd6125d49ec7b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:56.928966 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:56.938991 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9dc7-4602-41d2-91cc-712d6fff1c3a service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:56.957453 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:56.993517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:56.994411 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:56.994696 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:56.994972 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] PATH_INFO: `/v3/users/3fde94fe375f4c5f97f45f762b079e57` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:56.996145 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fde94fe375f4c5f97f45f762b079e57)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:56.998079 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:57.199992 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fde94fe375f4c5f97f45f762b079e57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.211989 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fde94fe375f4c5f97f45f762b079e57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.212659 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fde94fe375f4c5f97f45f762b079e57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.219604 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fde94fe375f4c5f97f45f762b079e57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.220246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-21ce04ad-0515-45e4-8132-4dbf39fac55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fde94fe375f4c5f97f45f762b079e57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.306344 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1449/2886] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:20:56 2022] DELETE /identity/v3/users/3fde94fe375f4c5f97f45f762b079e57 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:57.691238 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:57.694806 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:57.706106 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781343-81f6-4eda-91ac-cbdb5ab4c2dc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:57.763234 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:57.764021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:57.764304 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:57.764583 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] PATH_INFO: `/v3/projects/025cf25956d74a808a38d008cd143cc9` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:57.765774 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=025cf25956d74a808a38d008cd143cc9)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:57.767713 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:57.840599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:57.849387 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025cf25956d74a808a38d008cd143cc9', 'request_id': 'req-4577d380-63f3-4e7c-9f21-8c03ab34f46d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.855415 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025cf25956d74a808a38d008cd143cc9', 'request_id': 'req-4577d380-63f3-4e7c-9f21-8c03ab34f46d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.860733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025cf25956d74a808a38d008cd143cc9', 'request_id': 'req-4577d380-63f3-4e7c-9f21-8c03ab34f46d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.927858 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] The token cache is being invalidate because project 025cf25956d74a808a38d008cd143cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:20:57.928178 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.928786 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4577d380-63f3-4e7c-9f21-8c03ab34f46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:20:57.930472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1438/2887] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:20:57 2022] DELETE /identity/v3/projects/025cf25956d74a808a38d008cd143cc9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 21:20:57.936369 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:57.936870 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:57.937015 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:57.955460 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:57.957448 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:58.013397 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1450/2888] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:58.023152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.023451 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.023733 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.042341 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:58.043570 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:58.051381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1439/2889] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:58.055362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.064798 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76972ee6-992c-4296-a7ba-0ae1a10a0e9b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.069720 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.070404 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.070690 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.070967 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.071700 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 21:20:58.072007 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.073630 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.085569 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1451/2890] 10.222.0.55 () {58 vars in 1152 bytes} [Tue May 31 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 21:20:58.089745 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.099231 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071994d-8356-4d1a-a30f-d652df998961 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.103834 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.104475 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.104757 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.105032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.105723 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.107636 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.187954 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1440/2891] 10.222.0.55 () {60 vars in 1152 bytes} [Tue May 31 21:20:58 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 21:20:58.197610 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.208307 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b41b1-eb6a-49d0-b7ff-18b2e465acb2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.233783 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:20:58.263827 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.265036 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.265313 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.266262 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.266964 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.268852 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.397855 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1452/2892] 10.222.0.55 () {60 vars in 1143 bytes} [Tue May 31 21:20:58 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 21:20:58.401881 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.411926 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cc009-f2a7-4dde-84ef-d72d6ca6790b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.416462 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.417157 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.417428 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.417704 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.418472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.420114 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.430272 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1441/2893] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:58.434054 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.444478 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec1f74-7c4c-4080-afd1-8e5d130ab133 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.449240 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.450290 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.450577 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.450856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.451583 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.453824 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb52bb-b383-44b0-ab17-8ed1db6af178 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.463488 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1453/2894] 10.222.0.55 () {58 vars in 1121 bytes} [Tue May 31 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 21:20:58.467421 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.477256 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7779-32a1-4d6d-ad16-52dd48c6e8ff admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.481679 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.482573 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.482850 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.483120 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] PATH_INFO: `/v3/projects/633b813ffa9945a180e2995ca41fe525/users/d34a38c6afbe4d488bc86f96067d6222/roles/ba84795116f349709142360a12649701` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.497004 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633b813ffa9945a180e2995ca41fe525, user_id=d34a38c6afbe4d488bc86f96067d6222, role_id=ba84795116f349709142360a12649701)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.499645 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.586022 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1442/2895] 10.222.0.55 () {60 vars in 1482 bytes} [Tue May 31 21:20:58 2022] PUT /identity/v3/projects/633b813ffa9945a180e2995ca41fe525/users/d34a38c6afbe4d488bc86f96067d6222/roles/ba84795116f349709142360a12649701 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:20:58.597388 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.597684 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.598005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.623893 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] MFA Rules not processed for user `d34a38c6afbe4d488bc86f96067d6222`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:20:58.625767 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:58.688283 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1454/2896] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:20:58.700598 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:20:58.702282 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:20:58.778952 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f662-c26e-4712-a624-0f05ccd3c392 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:20:58.783148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc9e81f64b024659aea31521c6f5fb03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:20:58.783789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:20:58.784069 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:20:58.784343 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:20:58.792782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:20:58.794259 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:20:58.803091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1443/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:21:08.685281 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:08.799008 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=73,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:13.858519 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:13.859974 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:13.916591 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e76d53-2609-45f6-b54d-90996ef5f202 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:13.920129 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:13.920769 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:13.921055 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:13.921333 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:13.923087 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:13.979727 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:13.981148 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:13.989951 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1455/2898] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:21:14.863378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:14.863378 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:14.953071 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e790b-5bc6-417e-8af3-4ea0c5392200 service glance] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:14.958746 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ac9c94438bf4a0b8a603d472ca317f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:14.959404 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:14.959689 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:14.959966 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:14.961818 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:14.974596 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:14.976192 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:14.988183 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1444/2899] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:21:20.141022 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:20.142468 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:20.153981 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c59f63-a65a-4258-a397-dd9a16ca260e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:20.157517 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:20.158192 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:20.158473 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:20.158747 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:20.160605 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:20.223149 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:20.224580 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:20.234128 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1456/2900] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:21:24.982402 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=34 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:27.090152 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:27.091599 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:27.105739 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf11e-0b1f-4137-a7b0-b7e301b2b065 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:27.110780 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:27.114302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:27.114302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:27.114302 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] PATH_INFO: `/v3/users/782845f8e6a440b684ae46a6ed118a62` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:27.114647 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] RBAC: Authorizing `identity:delete_user(user_id=782845f8e6a440b684ae46a6ed118a62)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:27.116289 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:27.329816 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782845f8e6a440b684ae46a6ed118a62'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.341359 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782845f8e6a440b684ae46a6ed118a62'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.342102 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782845f8e6a440b684ae46a6ed118a62'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.349340 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782845f8e6a440b684ae46a6ed118a62'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.350036 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782845f8e6a440b684ae46a6ed118a62'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.413260 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1445/2901] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:21:27 2022] DELETE /identity/v3/users/782845f8e6a440b684ae46a6ed118a62 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:27.654092 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:27.668487 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9db6-4505-4f64-9848-d63bccb981a8 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:27.716667 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:27.729182 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:27.730080 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:27.730362 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:27.730634 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] PATH_INFO: `/v3/projects/d9c46b1e7a32484b9c22387f2aaeb871` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:27.731863 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c46b1e7a32484b9c22387f2aaeb871)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:27.733743 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:27.855247 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c46b1e7a32484b9c22387f2aaeb871', 'request_id': 'req-583f8576-4a38-4df4-bbee-4c5514db84ec'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.937917 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c46b1e7a32484b9c22387f2aaeb871', 'request_id': 'req-583f8576-4a38-4df4-bbee-4c5514db84ec'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.944196 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c46b1e7a32484b9c22387f2aaeb871', 'request_id': 'req-583f8576-4a38-4df4-bbee-4c5514db84ec'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.955140 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] The token cache is being invalidate because project d9c46b1e7a32484b9c22387f2aaeb871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:21:27.955427 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.956573 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:27.958141 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1457/2902] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:21:27 2022] DELETE /identity/v3/projects/d9c46b1e7a32484b9c22387f2aaeb871 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:27.962158 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:27.963549 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:27.977119 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a94f-e2d4-4907-bb61-d665c94b362a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:28.035124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:28.036009 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:28.036291 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:28.036624 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] PATH_INFO: `/v3/users/9a4c3137728e4203b126f963218d9fbc` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:28.037789 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4c3137728e4203b126f963218d9fbc)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:28.039907 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:28.232747 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4c3137728e4203b126f963218d9fbc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.244363 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4c3137728e4203b126f963218d9fbc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.245021 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4c3137728e4203b126f963218d9fbc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.252124 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4c3137728e4203b126f963218d9fbc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.253297 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4c3137728e4203b126f963218d9fbc'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.255131 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:28.361637 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1446/2903] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:21:27 2022] DELETE /identity/v3/users/9a4c3137728e4203b126f963218d9fbc => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:28.621856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:28.621856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:28.632275 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8576-4a38-4df4-bbee-4c5514db84ec admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:28.691030 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:28.692146 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:28.692424 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:28.692694 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] PATH_INFO: `/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:28.693856 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfaa71f564d47c1b9fc6cca168c2629)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:28.695757 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:28.820059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfaa71f564d47c1b9fc6cca168c2629', 'request_id': 'req-86ac983f-0411-48a4-8fb1-79d23d029aa5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.893365 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfaa71f564d47c1b9fc6cca168c2629', 'request_id': 'req-86ac983f-0411-48a4-8fb1-79d23d029aa5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.899274 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfaa71f564d47c1b9fc6cca168c2629', 'request_id': 'req-86ac983f-0411-48a4-8fb1-79d23d029aa5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.910718 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] The token cache is being invalidate because project 4cfaa71f564d47c1b9fc6cca168c2629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:21:28.911005 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.911632 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86ac983f-0411-48a4-8fb1-79d23d029aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:28.913176 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1458/2904] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:21:28 2022] DELETE /identity/v3/projects/4cfaa71f564d47c1b9fc6cca168c2629 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:38.505085 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:38.907120 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:39.931808 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:39.933299 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:39.946002 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2699-931b-4875-9db3-76fba0eda40e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:40.000472 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:40.001325 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:40.001604 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:40.001876 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] PATH_INFO: `/v3/users/d34a38c6afbe4d488bc86f96067d6222` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:40.003096 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34a38c6afbe4d488bc86f96067d6222)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:40.004982 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:40.147041 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34a38c6afbe4d488bc86f96067d6222'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:40.158782 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34a38c6afbe4d488bc86f96067d6222'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:40.159468 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34a38c6afbe4d488bc86f96067d6222'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:40.166166 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34a38c6afbe4d488bc86f96067d6222'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:40.166783 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34a38c6afbe4d488bc86f96067d6222'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:40.213032 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1447/2905] 10.222.0.55 () {58 vars in 1223 bytes} [Tue May 31 21:21:39 2022] DELETE /identity/v3/users/d34a38c6afbe4d488bc86f96067d6222 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:40.217524 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:40.218059 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:40.218180 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:40.235246 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] MFA Rules not processed for user `8f14392ec7e347fab1ef8b6cbe7e2488`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 21:21:40.236466 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:40.292730 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1459/2906] 10.222.0.55 () {58 vars in 957 bytes} [Tue May 31 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 21:21:40.302243 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:40.303690 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:40.361580 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d5fdd-5946-48e4-8ba8-42c7873d92fe admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:40.365294 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb92fb4d1d124af781f1dc10ca2cb4a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:40.365964 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:40.366300 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:40.366528 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:40.375331 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:40.376750 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:40.386523 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1448/2907] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:21:40.803401 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:21:40.804820 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:21:40.819701 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dc06e-b4c9-41b5-ba9c-d873fc463876 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:21:40.824560 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f14392ec7e347fab1ef8b6cbe7e2488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a1a8d766964543bcc4e46371605ff7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:21:40.826585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:21:40.828797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:21:40.828797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] PATH_INFO: `/v3/projects/633b813ffa9945a180e2995ca41fe525` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:21:40.828797 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633b813ffa9945a180e2995ca41fe525)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:21:40.830585 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:21:40.949677 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633b813ffa9945a180e2995ca41fe525', 'request_id': 'req-0acd0f29-d2a6-4775-ab5a-7e6002477296'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:41.016777 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633b813ffa9945a180e2995ca41fe525', 'request_id': 'req-0acd0f29-d2a6-4775-ab5a-7e6002477296'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:41.022426 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633b813ffa9945a180e2995ca41fe525', 'request_id': 'req-0acd0f29-d2a6-4775-ab5a-7e6002477296'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:41.033273 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] The token cache is being invalidate because project 633b813ffa9945a180e2995ca41fe525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 21:21:41.033562 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:41.034741 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0acd0f29-d2a6-4775-ab5a-7e6002477296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 21:21:41.036295 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1460/2908] 10.222.0.55 () {58 vars in 1232 bytes} [Tue May 31 21:21:40 2022] DELETE /identity/v3/projects/633b813ffa9945a180e2995ca41fe525 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 21:21:50.382381 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:21:51.030546 dv-cinder-839793-16-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 21:22:40.966702 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 21:22:40.968091 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:22:41.037409 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22974081-f266-4678-a234-39dbf98e8cee service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 21:22:41.094936 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b4d719ef17413e8f7c69f84348851a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdbd36d7f7b49dead3e86dd064707f3', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 21:22:41.095601 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 21:22:41.095872 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 21:22:41.096148 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 21:22:41.097925 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 21:22:41.109181 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 21:22:41.110770 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d1035-737a-486f-9ba1-818662d56e43 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 21:22:41.120538 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1449/2909] 10.222.0.55 () {60 vars in 1365 bytes} [Tue May 31 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 21:22:51.116345 dv-cinder-839793-16-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=58 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}